Skip to main content
SpringerLink
Log in

Video Summarization: Techniques and Classification

  • Conference paper
Computer Vision and Graphics (ICCVG 2012)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7594))

Included in the following conference series:

Abstract

A large number of cameras record video around the clock, producing huge volumes. Processing these huge chunks of videos demands plenty of resources like time, man power, and hardware storage etc. Video summarization plays an important role in this context. It helps in efficient storage, quick browsing, and retrieval of large collection of video data without losing important aspects. In this paper, we categorize video summariztion methods on the basis of methodology used, provide detailed description of leading methods in each category, and discuss their advantages and disadvantages. Moreover, we discuss the situation in which each method is most suitable to use. The advantage of this research is that one can quickly learn different video summarization techniques, and select the method that is the most suitable according to one’s requirements.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Divakaran, A., Peker, K.A., Sun, H.: Video Summarization Using Motion Descriptors. In: Conf. on Storage and Retrieval from Multimedia Databases (2001)

    Google Scholar 

  2. Ju, S.X., Black, M.J., Minneman, S., Kimber, D.: Summarization of Video-Taped Presentations: Automatic Analysis of Motion and Gestures. IEEE Transactions on CSVT (1998)

    Google Scholar 

  3. Fujimur, K., Honda, K., Uehara, K.: Automatic Video Summarization by Using Color and Utterance Information. In: Proceedings 2002 IEEE International (2002)

    Google Scholar 

  4. Zhang, H.J., Low, C.Y., Smoliar, S.W.: Video parsing and browsing using compressed data. Multimedia Tools and Applications 1, 89–111 (1995)

    Article  Google Scholar 

  5. DeManthon, D., Kobla, V., Doermann, D.: Video Summarization by Curve Simplification. In: Proceedings of the Sixth ACM International Conference on Multimedia (1998)

    Google Scholar 

  6. Koskela, M., Sjberg, M., Laaksonen, J., Viitaniemi, V., Muurinen, H.: Rushes Summarization with Self-Organizing Maps. In: Proceedings of the International Workshop on TRECVID Video Summarization (2007)

    Google Scholar 

  7. Truong, B.T., Venkatesh, S.: Video Abstraction: a Systematic Review and Classification. ACM Transactions on Multimedia Computing, Communications, and Applications 3(1) (2007)

    Google Scholar 

  8. Li, Y., Zhang, T., Tretter, D.: An Overview of Video Aabstraction Techniques. Technical Report HPL (2001)

    Google Scholar 

  9. Barbieri, M., Agnihotri, L., Dimitrova, N.: Video summarization: methods and landscape. In: Proceedings of SPIE, vol. 5242, p. 1 (2003)

    Google Scholar 

  10. Adami, N., Benini, S., Leonardi, R.: An Overview of Video Shot Clustering and Summarization Techniques for Mobile Applications. In: Proceedings of the 2nd International Conference on Mobile Multimedia Communications (2006)

    Google Scholar 

  11. Wolf, W.: Key frame selection by motion analysis. In: ICASSP, vol. 2, pp. 1228–1231 (1996)

    Google Scholar 

  12. Wang, F., Ngo, C.W.: Summarizing rushes videos by motion, object and event understanding. IEEE Transactions on Multimedia 14 (2012)

    Google Scholar 

  13. Zhang, H.J., Wu, J., Zhong, D., Smoliar, S.W.: An integrated system for content based video retrieval and browsing. Pattern Recognition 30, 643–658 (1997)

    Article  Google Scholar 

  14. Chheng, T.: Video Summarization Using Clustering. Department of Computer Science University of California, Irvine (2007)

    Google Scholar 

  15. Damnjanovic, U., Fernandez, V., Izquierdo, E.: Event Detection and Clustering for Surveillance Video Summarization. In: Proceedings of the Ninth International Workshop on Image Analysis for Multimedia Interactive Services. IEEE Computer Society, Washington, USA (2008)

    Google Scholar 

  16. Hanjalic, A., Zhang, H.: An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis. IEEE Transactionson Circuits and Systems for Video Technology 9, 1280–1289 (1999)

    Article  Google Scholar 

  17. Vctor Valdes, J.M.M.: On-Line Video Skimming Based on Histogram Similarity. In: Proceedings of the International Workshop on TRECVID Video Summarization (2007)

    Google Scholar 

  18. Li, B., Sezan, M.I.: Event Detection and Summarization in Sports Video. In: Content-Based Access of Image and Video Libraries, CBAIVL IEEE Workshop (2001)

    Google Scholar 

  19. Uchihachi, S., Foote, J., Wilcox, L.: Automatic Video Summarization Using a Measure of Shot Importance and a Frame Packing Method. United States Patent 6, 535,639, March 18 (2003)

    Google Scholar 

  20. Evangelopoulos, G., Rapantzikos, K., Potamianos, A., Maragos, P., Zlatintsi, A., Avrithis, Y.: Movie Summarization Based on Audio-Visual Valiency Detection. In: IEEE Intl Conf. Image Processing (ICIP), San Diego, CA (2008)

    Google Scholar 

  21. Wang, J., Adelson, E.: Representing moving images with layers. IEEE Transactions on Image Processing 3 (1994)

    Google Scholar 

  22. Pope, A., Kumar, R., Sawhney, H., Wan, C.: Video abstraction: Summarizing video content for retrieval and visualization (1998)

    Google Scholar 

  23. Aner, A., Kender, J.R.: Video Summaries through Mosaic-Based Shot and Scene Clustering. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002, Part IV. LNCS, vol. 2353, pp. 388–402. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  24. Sawhney, H., Ayer, S.: Compact representation of video through dominent and multiple motion estimation. IEEE Trans. on Pattern. Analysis and Machine Intelligence 18 (1996)

    Google Scholar 

  25. Lee, C.H., Varshney, A., Jacob, D.W.: Mesh saliency. ACM Transaction on Graphics, 659–666 (2005)

    Google Scholar 

  26. Ngo, C.W., Ma, Y.F., Zhang, H.J.: Automatic Video Summarization by Graph Modeling. In: Proceedings of the 9th IEEE International Conference on Computer Vision (2003)

    Google Scholar 

  27. Qiu, X., Jiang, S., Liu, H., Huang, Q., Cao, L.: Spatial temporal attention analysis for home video. In: IEEE International Multimedia and Expo, vol. 23 (2008)

    Google Scholar 

  28. Bulut, E., Capin, T.: Key Frame Extraction from Motion Capture Data by Curve Saliency. In: Proceedings of 20th Annual Conference on Computer Animation and Social Agents, Belgium (2007)

    Google Scholar 

  29. Peyrard, N., Bouthemy, P.: Motion-Based Selection of Relevant Video Segments for Video Summarization 26(3) (2005)

    Google Scholar 

  30. Li, C., Wu, Y.T., Yu, S.S., Chen, T.: Motion-focusing key frame extraction and video summarization for lane surveillance system. In: 16th IEEE International Conference on Image Processing (ICIP), pp. 7–10 (2009)

    Google Scholar 

  31. Chen, F., Cooper, M., Adcock, J.: Video Summarization Preserving Dynamic Content. In: Proceedings of the International Workshop on TRECVID Video Summarization (2007)

    Google Scholar 

  32. Adnan, H., Mufti, M.: Video Summarization Based Handout Generation from Video Lectures: A Gesture Recognition Framework. In: 5th WSEAS International Conference on Signal Processing, Computational Geometry and Artificial Vision (2005)

    Google Scholar 

  33. Kosmopoulos, D.I., Doulamis, A., Doulamis, N.: Gesture-based video summarization. In: ICIP IEEE International Image Processing, pp. 11–14 (2005)

    Google Scholar 

  34. Furini, M., Ghini, V.: An Audio-Video Summarization Scheme Based on Audio and Video Analysis. In: IEEE CCNC (2006)

    Google Scholar 

  35. Divakaran, A., Peker, K., Radhakrishnan, R., Xiong, Z., Cabasson, R.: Video summarization using mpeg7 motion activity and audio descriptors. In: Video Mining, vol. 91 (2003)

    Google Scholar 

  36. Evangelopoulos, G., Rapantzikos, K., Potamianos, A., Maragos, P., Zlatintsi, A., Avrithis, Y.: Movie Summarization Based on Audiovisual Saliency Detection. In: ICIP (2008)

    Google Scholar 

  37. Shao, X., Xu, C., Maddage, N.C., Kankanhalli, M.S., Jin, J.S., Tian, Q.: Automatic summarization of music videos. ACM Transactions on Multimedia Computing,Communications and Applications (TOMCCAP) 2 (2006)

    Google Scholar 

  38. Taskiran, C.M., Amir, A., Ponceleon, D., Delp, E.J.: Auto-mated video summarization using speech transcripts. In: Proceedings of SPIE Conference on Storage and Retrieval for Media Databases volume, San Jose, CA, pp. 20–25 (2002)

    Google Scholar 

  39. Taskiran, C.M., Pizlo, Z., Amir, A., Ponceleon, D., Delp, E.J.: Automated video program summarization using speech transcripts. IEEE Transactions on Multimedia (2006)

    Google Scholar 

  40. Bahl, L.R., Aiyer, S.B., Bellegarda, J.R., Franz, M., Gopalakrisnan, P.S., Nahamoo, D., Novak, M., Padmanabhan, M., Picheny, M.A., Roukos, S.: Performance of the IBM Large Vocabulary Continuous Speech Recognition System on the ARPA Wall Street Journal Task. In: Proceedings of IEEE International Conference on Acoustic, Speech and Signal Processing, Detroit, MI (1995)

    Google Scholar 

  41. Dunning, T.E.: Accurate methods for the statistics of surprise and coincidence. Computational Linguistics 19(1), 61–74 (1993)

    Google Scholar 

  42. Liu, D., Chen, T., Hua, G.: A hierarchical visual model for video object summarization. IEEE Transactions on Pattern Analysis and Machine Intelligence 32 (2010)

    Google Scholar 

  43. Kim, C., Hwang, J.N.: An Integrated Scheme for Object-Based Video Abstraction. In: Proceedings of the 8th ACM International Conference on Multimedia (2000)

    Google Scholar 

  44. Lee, Y.J., Ghosh, J., Grauman, K.: Discovering Important People and Objects for Egocentric Video Summarization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR (2012)

    Google Scholar 

  45. Ferman, A.M., Gunsel, B., Tekalp, A.M.: Object-Based Indexing of MPEG-4 Compressed Video. In: Proceedings of IS&T/SPIE Symp. on Electronic Imaging (1997)

    Google Scholar 

  46. Pritch, Y., Ratovitch, S., Hendel, A., Peleg, S.: Clustered synopsis of surveillance video. In: 6th IEEE Int Conf. on Advance Video and Signal Base Selection (AVSS 2009), Genoa, Italy, pp. 2–4 (2009)

    Google Scholar 

  47. Ali Amiri, M.F.: Hierarchical key frame-based video summarization using qr-decomposition and modified k-means clustering. EURASIP Journal on Advaces in Signal Processing (February 2010)

    Google Scholar 

  48. Farin, D., Effelsberg, W., Peter, H.N.: Robust Clustering Based Video Summarization with Integration of Domain Knowledge. In: Proceedings 2002 IEEE International Conference (2002)

    Google Scholar 

  49. Jain, A.K., Dubes, R.C.: Algorithms for Clustering Data. Prentice-Hall, Englewood Cliffs (1988)

    MATH  Google Scholar 

  50. Peker, K.A., Bashir, F.I.: Content-Based Video Summarization using Spectral Clustering. Mitsubishi Electric Research Laboratories Cambridge, MA. University of Illinois at Chicago, Chicago, IL (2009)

    Google Scholar 

  51. Girgensohn, A., Foote, J.: Video Frame Classification Using Transform Coefficients. In: ICASSP 1999 (1999)

    Google Scholar 

  52. Stefanidis, A., Partsinevelos, P., Peggy Agouris, P.D.: Summarizing Video Datasets in the Spatiotemporal Domain (2000)

    Google Scholar 

  53. Massey, M., Bender, W.: Salient stills: Process and practice. IBM Systems Journal 35 (1996)

    Google Scholar 

  54. Lee, M., Chen, W., Lin, C., Gu, C., Markoc, T., Zabinsky, S., Szeliski, R.: A layered video object coding system using sprite and affine motion model. IEEE Transactions on Circuits and Systems for Video Technology (1997)

    Google Scholar 

  55. Vasconcelos, N., Lippman, A.: A Spatio Temporal Motion Model for Video Summarization. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (1998)

    Google Scholar 

  56. Iran, M., Anandan, P.: Video indexing based on mosaic representation. IEEE Computer Society (1998)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. COMSATS Institute of Information Technology, M.A. Jinnah Building Defence Road, Off Raiwind Road, Lahore, Pakistan

    Muhammad Ajmal, Muhammad Husnain Ashraf, Muhammad Shakir, Yasir Abbas & Faiz Ali Shah

Authors
  1. Muhammad Ajmal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muhammad Husnain Ashraf
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Muhammad Shakir
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yasir Abbas
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Faiz Ali Shah
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Polish-Japanese Institute of Information Technology, 86 Koszykowa, 02-008, Warsaw, Poland

    Leonard Bolc

  2. AGH University of Science and Technology, Mickiewicza 30, 30-059, Kraków, Poland

    Ryszard Tadeusiewicz

  3. Faculty of Applied Informatics and Mathematics, Department of Informatics, Warsaw University of Life Sciences (SGGW), Nowoursynowska 159, 02-776, Warsaw, Poland

    Leszek J. Chmielewski

  4. Polish-Japanese Institute of Information Technology, Koszykowa 86, 02-008, Warszawa, Poland

    Konrad Wojciechowski

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ajmal, M., Ashraf, M.H., Shakir, M., Abbas, Y., Shah, F.A. (2012). Video Summarization: Techniques and Classification. In: Bolc, L., Tadeusiewicz, R., Chmielewski, L.J., Wojciechowski, K. (eds) Computer Vision and Graphics. ICCVG 2012. Lecture Notes in Computer Science, vol 7594. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33564-8_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33564-8_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33563-1

  • Online ISBN: 978-3-642-33564-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation