Skip to main content

Watermarking and Fingerprinting

  • Chapter
  • First Online:
MediaSync
  • 698 Accesses

Abstract

An important task in media synchronisation is to find out the playback position of a running media stream. Only based on this information, it is possible to provide additional information or additional streams synchronised to that running stream. This chapter gives an overview of two techniques for solving this basic task: watermarking and fingerprinting. In the former, synchronisation information is embedded imperceptibly in the media stream. In the latter, an excerpt of the media stream is identified based on an index of compact representations of known media content. In both cases, there are specific approaches for audio, image, and video signals. In all cases, the robustness of the methods may be increased by using error correcting codes.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 44.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 59.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 59.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Allamanche, E., Herre, J., Hellmuth, O., Fröba, B., Cremer, M.: Audioid: towards content-based identification of audio material. In: 110th AES Convention

    Google Scholar 

  2. Arzt, A., Widmer, G., Böck, S., Sonnleitner, R., Frostel, H.: Towards a complete classical music companion. In: Raedt, L., Bessière, C., Dubois, D., Doherty, P., Frasconi, P., Heintz, F., Lucas, P.J.F. (eds.), ECAI, Frontiers in Artificial Intelligence and Applications, vol. 242, pp. 67–72. IOS Press (2012)

    Google Scholar 

  3. Baras, C., Moreau, N., Dymarski, P.: Controlling the inaudibility and maximizing the robustness in an audio annotation watermarking system. IEEE Trans. Audio, Speech, Lang. Process. 14(5), 1772–1782 (2006)

    Article  Google Scholar 

  4. Bardeli, R., Kurth, F.: Robust identification of time-scaled audio. In: Audio Engineering Society Conference: 25th International Conference: Metadata for Audio, Jun 2004

    Google Scholar 

  5. Bardeli, R., Schwenninger, J., Stein, D.: Audio fingerprinting for media synchronisation and duplicate detection. In: Media Synchronisation Workshop (2012)

    Google Scholar 

  6. Böck, S., Schedl, M.: Polyphonic piano note transcription with recurrent neural networks. In: 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 121–124, March 2012

    Google Scholar 

  7. Cano, P., Batlle, E., Mayer, H., Neuschmied, H.: Robust sound modeling for song detection in broadcast audio. In: Audio Engineering Society Convention, vol. 112, Apr 2002

    Google Scholar 

  8. Cano, P., Batlle, E., Kalker, T., Haitsma, J.: A review of audio fingerprinting. VLSI Signal Process. 41(3), 271–284 (2005)

    Google Scholar 

  9. Clausen, M., Kurth, F.: A unified approach to content-based and fault-tolerant music recognition. IEEE Trans. Multimedia 6(5), 717–731 (2004)

    Article  Google Scholar 

  10. Coskun, B., Sankur, B., Memon, N.: Spatio-temporal transform based video hashing. IEEE Trans. Multimedia 8(6), 1190–1208 (2006)

    Article  Google Scholar 

  11. Coskun, B., Sankur, B.: Robust video hash extraction. In: 2004 12th European Signal Processing Conference, September 6-10, 2004, pp. 2295–2298. Vienna, Austria (2004)

    Google Scholar 

  12. Deguillaume, F., Csurka, G., O’Ruanaidh, J.J., Pun, T.: Robust 3d DFT video watermarking. In: Electronic Imaging’99, pp. 113–124. International Society for Optics and Photonics (1999)

    Google Scholar 

  13. Fastl, H., Zwicker, E.: Psychoacoustics: facts and models. In: Springer Series in Information Sciences. Springer, New York (1998)

    Google Scholar 

  14. Galar, M., Derrac, J., Peralta, D., Triguero, I., Paternain, D., Lopez-Molina, C., Garca, S., Bentez, J.M., Pagola, M., Barrenechea, E., Bustince, H., Herrera, F.: A survey of fingerprint classification part i: taxonomies on feature extraction methods and learning models. Knowl. Based Syst. 81, 76–97 (2015)

    Google Scholar 

  15. Galar, M., Derrac, J., Peralta, D., Triguero, I., Paternain, D., Lopez-Molina, C., Garca, S., Bentez, J.M., Pagola, M., Barrenechea, E., Bustince, H., Herrera, F.: Experimental analysis and ensemble proposal. A survey of fingerprint classification part ii. Knowl. Based Syst. 81, 98–116 (2015)

    Google Scholar 

  16. Haitsma, J., Kalker, T.: A highly robust audio fingerprinting system. ISMIR 107–115 (2002) (2002)

    Google Scholar 

  17. Hamming, R.W.: Error detecting and error correcting codes. Bell Syst. Tech. J. 26(2), 147–160 (1950)

    Article  MathSciNet  Google Scholar 

  18. Hampapur, A., Hyun, K., Bolle, R.M.: Comparison of sequence matching techniques for video copy detection. In: Storage and Retrieval for Media Databases 2002, January 23, 2002, pp. 194–201. San Jose, CA, USA (2002)

    Google Scholar 

  19. Hua, G., Huang, J., Shi, Y.Q., Goh, J., Vrizlynn, L.L.: Thing. Twenty years of digital audio watermarking—a comprehensive review. Signal Process. 128, 222–242 (2016)

    Google Scholar 

  20. Kim, H.-G., Cho, H.-S., Kim, J.Y.: Robust audio fingerprinting using peak-pair-based hash of non-repeating foreground audio in a real environment. Clust. Comput. 19(1), 315–323 (2016)

    Google Scholar 

  21. Kirovski, D., Malvar, H.S.: Spread-spectrum watermarking of audio signals. IEEE Trans. Signal Process. 51(4), 1020–1033 (2003)

    Article  MathSciNet  MATH  Google Scholar 

  22. Kurth, F., Müller, M., Damm, D., Fremerey, C., Ribbrock, A., Clausen, M.: Syncplayer-an advanced system for multimodal music access. ISMIR 5, 381–388 (2005)

    Google Scholar 

  23. Kurth, F., Ribbrock, A., Clausen, M.: Identification of highly distorted audio material for querying large scale data bases. In: In Proceedings 112th AES Convention, p. 9 (2002)

    Google Scholar 

  24. Law-To, J., Buisson, O., Gouet-Brunet, V., Boujemaa, N.: Robust voting algorithm based on labels of behavior for video copy detection. In: Proceedings of the 14th ACM International Conference on Multimedia, October 23–27, 2006, pp. 835–844. Santa Barbara, CA, USA (2006)

    Google Scholar 

  25. Lin, S.D., Shie, S.-C., Guo, J.Y.: Improving the robustness of DCT-based image watermarking against JPEG compression. Comput. Stand. Interfaces 32(12), 54–60 (2010)

    Google Scholar 

  26. Lowe, D.G.: Object recognition from local scale-invariant features. In: Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on, vol. 2, pp. 1150–1157 (1999)

    Google Scholar 

  27. Meerwald, P., Uhl, A.: A survey of wavelet-domain watermarking algorithms. In: Proceedings of SPIE, Electronic Imaging, Security and Watermarking of Multimedia Contents III, pp. 505–516. SPIE (2001)

    Google Scholar 

  28. nan Li, Y.: Robust content fingerprinting algorithm based on sparse coding. IEEE Signal Process. Lett. 22(9), 1254–1258 (2015)

    Google Scholar 

  29. Oostveen, J., Kalker, T., Haitsma, J.: Feature extraction and a database strategy for video fingerprinting. In: Recent Advances in Visual Information Systems, 5th International Conference, VISUAL 2002, March 11–13, 2002, Proceedings, pp. 117–128. Hsin Chu, Taiwan (2002)

    Google Scholar 

  30. Ouali, C., Dumouchel, P., Gupta, V.: Fast audio fingerprinting system using GPU and a clustering-based technique. IEEE/ACM Trans. Audio, Speech, Lang. Process. 24(6), 1106–1118 (2016)

    Article  Google Scholar 

  31. Radhakrishnan, R., Bauer, C.: Content-based video signatures based on projections of difference images. In: IEEE 9th Workshop on, Multimedia Signal Processing, 2007. MMSP 2007, pp. 341–344, Oct 2007

    Google Scholar 

  32. Radhakrishnan, R., Bauer, C.: Video fingerprinting based on moment invariants capturing appearance and motion. In: Proceedings of the 2009 IEEE International Conference on Multimedia and Expo, ICME ’09, pp. 1532–1535. IEEE Press, Piscataway, NJ, USA (2009)

    Google Scholar 

  33. Ruanaidh, J.K.O., Pun, T.: Rotation, scale and translation invariant spread spectrum digital image watermarking. Signal Process. 66(3), 303–317 (1998)

    Google Scholar 

  34. Seo, J.S., Haitsma, J., Kalker, T., Yoo, C.D.: A robust image fingerprinting system using the Radon transform. Signal Process. Image Commun. 19(4), 325–339 (2004)

    Google Scholar 

  35. Shannon, C.E.: A mathematical theory of communication. Bell Syst. Tech. J., 27, 379–423, 623–656, July, Oct 1948

    Google Scholar 

  36. Shivakumar, N.: Detecting digital copyright violations on the internet. PhD Thesis. Stanford University (1999)

    Google Scholar 

  37. Tahboub, K., Neeraj, J.G., Mary, L.C., Edward, J.D.: An HEVC compressed domain content-based video signature for copy detection and video retrieval (2014)

    Google Scholar 

  38. Wang, A.: An industrial strength audio search algorithm. In: International Conference on Music Information Retrieval (ISMIR) (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rolf Bardeli .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Bardeli, R. (2018). Watermarking and Fingerprinting. In: Montagud, M., Cesar, P., Boronat, F., Jansen, J. (eds) MediaSync. Springer, Cham. https://doi.org/10.1007/978-3-319-65840-7_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65840-7_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65839-1

  • Online ISBN: 978-3-319-65840-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics