Skip to main content
SpringerLink
Log in

Detecting Sub-Image Replicas: Retrieval and Localization of Zoomed-In Images

  • Conference paper
  • First Online:
Computer Analysis of Images and Patterns (CAIP 2019)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11679))

Included in the following conference series:

  • 935 Accesses

Abstract

Zoomed-in image retrieval is a special field of near-duplicate image retrieval. It allows determining the sight, panorama or landscape image where a zoomed-in image belongs to. In addition, it can help to detect copyright violations of images that have been cropped and rescaled from panorama images. So far, only few research have been done on this problem using supervised learning techniques. We present a method to retrieve and localize zoomed-in images with respect to the whole scene based on correlating groups of features. Feature grouping is used to filter features that do not contribute to identifying relations between images. The remaining features are used to estimate the scale and location of the zoomed-in image with respect to the whole scene. We provide results of a benchmark data study using the proposed method to detect zoomed-in images and to localize them in the correlating whole scene images. We compare our method with the RANSAC model in case of zoomed-in retrieval and localization. The results indicate that our approach is more robust than the RANSAC model and can detect the relation and localize zoomed-in images even when most matched features are not correlated or only a few matches can be found.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Source for panorama images. Last proceeding, August 2018. http://en.wikipedia.org/wiki/User:Diliff#/media

  2. Alyosef, A.A., Nürnberger, A.: Adapted SIFT descriptor for improved near duplicate retrieval. In: Proceedings of the 5th ICPRAM, pp. 55–64 (2016)

    Google Scholar 

  3. Alyosef, A.A., Nürnberger, A.: The effect of SIFT features properties in descriptors matching for near-duplicate retrieval tasks. In: Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods, pp. 703–710 (2017)

    Google Scholar 

  4. Ahmad Alyosef, A., Nürnberger, A.: Near-duplicate retrieval: a benchmark study of modified SIFT descriptors. In: Fred, A., De Marsico, M., Sanniti di Baja, G. (eds.) ICPRAM 2016. LNCS, vol. 10163, pp. 121–138. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-53375-9_7

    Chapter  Google Scholar 

  5. Amerini, I., Ballan, L., Caldelli, R., Bimbo, A.D., Serra, G.: A SIFT-based forensic method for copy-move attack detection and transformation recovery. IEEE Trans. Inf. Forensics Secur. 6, 1099–1110 (2011)

    Article  Google Scholar 

  6. Auclair, A., Vincent, N., Cohen, L.A.: Hash functions for near duplicate image retrieval. In: WACV (2009)

    Google Scholar 

  7. Beis, J.S., Lowe, D.G.: Shape indexing using approximate nearest neighbour search in high-dimensional spaces. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1000–1006 (1997)

    Google Scholar 

  8. Bravo-Solorio, S., Nandi, A.K.: Exposing duplicated regions affected by reflection rotation and scaling. In: Proceedings of International Conference on Acoustics Speech and Signal Processing, pp. 1880–1883 (2011)

    Google Scholar 

  9. Christlein, V., Riess, C., Angelopoulou, E.: On rotation invariance in copy-move forgery detection. In: Proceedings of IEEE Workshop on Information Forensics and Security, pp. 129–134 (2010)

    Google Scholar 

  10. Chum, O., Philbin, J., Isard, M., Zisserman, A.: Scalable near identical image and shot detection. In: Proceedings of CIVR (2007)

    Google Scholar 

  11. Chum, O., Philbin, J., Zisserman, A.: Near duplicate image detection: min-Hash and tf-idf weighting. In: British Machine Vision Conference (2008)

    Google Scholar 

  12. Dubrofsky, E.: Homography estimation: Masterś essay carleton university. The University of British Columbia, pp. 1–32 (2009)

    Google Scholar 

  13. Fishler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 6, 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  14. Grauman, K., Darrell, T.: The pyramid match kernel: efficient learning with sets of features. J. Mach. Learn. Res. 8, 725–760 (2007)

    MATH  Google Scholar 

  15. Huang, H., Guo, W., Zhang, Y.: Detection of copy-move forgery in digital images using SIFT algorithm. In: Proceedings of Pacific-Asia Workshop on Computational Intelligence and Industrial Application (2008)

    Google Scholar 

  16. Huang, S., Hang, H.M.: Multi-query image retrieval using CNN and SIFT features. In: Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (2017)

    Google Scholar 

  17. Jiang, M., Zhang, S., Li, H., Metaxas, D.N.: Computer-aided diagnosis of mammographic masses using scalable image retrieval. IEEE Trans. Biomed. Eng. 62, 783–792 (2015)

    Article  Google Scholar 

  18. Ke, Y., Sukthankar, R.: PCA-SIFT: a more distinctive representation for local image descriptors. In: CVPR, pp. 506–513 (2004)

    Google Scholar 

  19. Ke, Y., Sukthankar, R., Huston, L., Chang, S.: Efficient near-duplicate detection and sub image retrieval. In: IEEE Trans. Proceedings of ACM International Conference on Multimedia, pp. 869–876 (2004)

    Google Scholar 

  20. Keys, R.: Cubic convolution interpolation for digital image processing. IEEE Trans. Acoust. Speech Signal Process. 29, 1153–1160 (1981)

    Article  MathSciNet  Google Scholar 

  21. Grauman, K., Darrell, T.: Pyramid match kernels: Discriminative classification with sets of image features. In: Proceedings of ICCV (2005)

    Google Scholar 

  22. Khan, N., McCane, B., Wyvill, G.: SIFT and SURF performance evaluation against various image deformations on benchmark dataset. In: DICTA (2011)

    Google Scholar 

  23. Lee, J.J., Kim., G.Y.: Robust estimation of camera homography using fuzzy RANSAC. In: ICCSA 07: International Conference on Computational Science and Its Applications (2007)

    Google Scholar 

  24. Leys, C., Ley, C., Klein, O., Bernard, P., Licata, L.: Detecting outliers: do not use standard deviation around the mean use absolute deviation around the median. J. Exp. Soc. Psychol. 49, 764–766 (2013)

    Article  Google Scholar 

  25. Li, J., Qian, X., Li, Q., Zhao, Y., Wang, L., Tang, Y.Y.: Mining near duplicate image groups. Multimedia Tools Appl. 74, 655–669 (2014)

    Article  Google Scholar 

  26. Lowe, D.: Distinctive image features from scale-invariant keypoints. J. Comput. Vis. 60, 91–110 (2004)

    Article  Google Scholar 

  27. Michaelsen, E., von Hansen, W., Kirchhof, M., Meidow, J., Stilla, U.: Estimating the essential matrix: GOODSAC versus RANSAC. In: Proceedings of the Photogrammetric Computer Vision, pp. 1–6 (2006)

    Google Scholar 

  28. Mikulik, A., Chum, O., Matas, J.: Image retrieval for online browsing in large image collections. In: Brisaboa, N., Pedreira, O., Zezula, P. (eds.) SISAP 2013. LNCS, vol. 8199, pp. 3–15. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-41062-8_2

    Chapter  Google Scholar 

  29. Nistèr, D., Stewènius, H.: Scalable recognition with a vocabulary tree. In: CVPR, pp. 2161–2168 (2006)

    Google Scholar 

  30. Pan, X., Lyu, S.: Region duplication detection using image feature matching. IEEE Trans. Inf. Forensics Secur. 5, 857–867 (2010)

    Article  Google Scholar 

  31. Radenovic, F., Tolias, G., Chum, O.: Fine-tuning CNN image retrieval with no human annotation. In arXiv (2017)

    Google Scholar 

  32. Raguram, R., Frahm, J.-M., Pollefeys, M.: A comparative analysis of RANSAC techniques leading to adaptive real-time random sample consensus. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5303, pp. 500–513. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-88688-4_37

    Chapter  Google Scholar 

  33. Rousseeuw, P.: Least median of squares regression. J. Am. Stat. Assoc. 79, 871–880 (1984)

    Article  MathSciNet  Google Scholar 

  34. Shechtman, E., Irani, M.: Matching local self-similarities across images and videos. In: Proceedings IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)

    Google Scholar 

  35. Xu, D., Cham, T., Yan, S., Duan, L., Chang, S.: Near duplicate identification with spatially aligned pyramid matching. IEEE Trans. Circ. Syst. Video Technol. 20, 1068–1079 (2010)

    Article  Google Scholar 

  36. Yang, Y., Newsam, S.: Comparing SIFT descriptors and Gabor texture features for classification of remote sensed imagery. In: Proceedings of the 15th IEEE on Image Processing, pp. 1852–1855 (2008)

    Google Scholar 

  37. Zhang, D.Q., et al.: Detecting image near-duplicate by stochastic attribute relational graph matching with learning. In: Proceedings of the 12th Annual ACM International Conference on Multimedia (2004)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Technical and Business Information Systems, Faculty of Computer Science, Otto von Geruicke University Magdeburgy, Magdeburg, Germany

    Afraà Ahmad Alyosef & Andreas Nürnberger

Authors
  1. Afraà Ahmad Alyosef
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andreas Nürnberger
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Afraà Ahmad Alyosef .

Editor information

Editors and Affiliations

  1. Department of Computer and Electrical Engineering and Applied Mathematics, University of Salerno, Fisciano (SA), Italy

    Mario Vento

  2. Department of Computer and Electrical Engineering and Applied Mathematics, University of Salerno, Fisciano (SA), Italy

    Gennaro Percannella

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ahmad Alyosef, A., Nürnberger, A. (2019). Detecting Sub-Image Replicas: Retrieval and Localization of Zoomed-In Images. In: Vento, M., Percannella, G. (eds) Computer Analysis of Images and Patterns. CAIP 2019. Lecture Notes in Computer Science(), vol 11679. Springer, Cham. https://doi.org/10.1007/978-3-030-29891-3_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-29891-3_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-29890-6

  • Online ISBN: 978-3-030-29891-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation