Skip to main content
Log in

An efficient compressed domain video indexing method

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Video indexing is employed to represent the features of video sequences. Motion vectors derived from compressed video are preferred for video indexing because they can be accessed by partial decoding; thus, they are used extensively in various video analysis and indexing applications. In this study, we introduce an efficient compressed domain video indexing method and implement it on the H.264/AVC coded videos. The video retrieval experimental evaluations indicate that the video retrieval based on the proposed indexing method outperforms motion vector based video retrieval in 74 % of queries with little increase in computation time. Furthermore, we compared our method with a pixel level video indexing method which employs both temporal and spatial features. Experimental evaluation results indicate that our method outperforms the pixel level method both in performance and speed. Hence considering the speed and precision characteristics of indexing methods, the proposed method is an efficient indexing method which can be used in various video indexing and retrieval applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Amir A, Berg M, Chang SF, Hsu W, Iyengar G, Lin CY, Naphade M, Natsev A, Neti C, Nock H (2003) IBM research TRECVID-2003 video retrieval system. NIST TRECVID-2003

  2. Ardizzone E, Cascia ML, Avanzato A, Bruna A (1999) Video indexing using MPEG motion compensation vectors. IEEE Int Conf Multimed Comput Syst 2:725–729

    Google Scholar 

  3. Babu RV, Ramakrishnan KR (2007) Compressed domain video retrieval using object and global motion descriptors. Multimed Tools Appl 93–113

  4. Barla A, Odone F, Verri A (2003) Histogram intersection kernel for image classification. Int Conf Image Process 3:513–516

    Google Scholar 

  5. Benois-Pineau J (2010) Indexing of compressed video: methods, challenges, applications. Int Conf Image Process Theory Tools Appl (IPTA) 3–4

  6. Campbell M, Hauboldy A, Ebadollahi S, Joshi D, Naphade MR, Natsev AP, Seidl J, Smith JR, Scheinberg K, Tesic J, Xie L (2006) IBM research TRECVID-2006 video retrieval system. In: Proceedings of the TREC Video Retrieval Evaluation (TRECVID)

  7. Gao L, Li Z, Katsaggelos A (2009) An efficient video indexing and retrieval algorithm using the luminance field trajectory modeling. IEEE Trans Circ Syst Video Technol 19(10):1566–1570

    Article  Google Scholar 

  8. ITU-T Rec. H.264/ISO/IEC 11496–10, “Advanced video coding for generic audiovisual services”, March 2005

  9. Joint Video Team of ITU-T VCEG and ISO/IEC MPEG, Joint Model Reference Software, Version 122

  10. Lie WN, Hsiao WC (2002) Content-based video retrieval based on object motion trajectory. IEEE Work Multimed Signal Process 237–240

  11. Mandal MK, Idris F, Panchanathan S (1999) A critical evaluation of image and video indexing techniques in the compressed domain. Image Vision Comput 17(7):513–529

    Article  Google Scholar 

  12. Manjunath BS, Salembier P, Sikora T (2002) Introduction to MPEG-7: multimedia content description interface, vol 1. John Wiley & Sons Inc

  13. Mehrabi M, Zargari F, Ghanbari M (2010) Fast and low complexity method for content accessing and extracting DC-frames from H.264 coded videos. IEEE Trans Consum Electron 56(3):1801–1808

    Article  Google Scholar 

  14. Mezaris V, Kompatsiaris I, Boulgouris NV, Strintzis MG (2004) Real-time compressed-domain spatiotemporal segmentation and ontologies for video indexing and retrieval. IEEE Trans Circ Syst Video Technol 14(5):606–621

    Article  Google Scholar 

  15. Natsev A, Smith JR, Hill M, Hua G, Huangy B, Merlery M, Xie L, Ouyangz H, Zhou M (2010) IBM research TRECVID-2010 video copy detection and multimedia event detection system. In: Proceedings of the TRECVID 2010 Workshop, Gaithersburg, MD, USA

  16. Qin YH, Li HL, Liu GH, Wang ZN (2010) Human action recognition using PEM histogram. Int Conf Comput Probl Solv (ICCP) 323–325

  17. Richardson IEG (2003) H.264 and MPEG-4 video compression. Wiley, West Sussex

    Book  Google Scholar 

  18. Sun X, Divakaran A, Manjunath BS (2001) A motion activity descriptor and it’s extraction in compressed domain. Adv Multimed Inf Process 450–457

  19. Takaya K (2006) Detection of scene changes for video indexing by means of the MPEG motion vectors. Int Symp Intell Signal Process Commun 447–450

  20. Venkatesh Babu R, Anantharaman B, Ramakrishnan KR, Srinivasan SH (2002) Compressed domain action classification using HMM. Pattern Recognit Lett 23(10):1203–1213

    Article  MATH  Google Scholar 

  21. Wang H, Divakaran A, Vetro A, Chang SF, Sun H (2003) Survey of compressed-domain features used in audio-visual indexing and analysis. J Vis Commun Image Represent 14:150–183

    Article  Google Scholar 

  22. Xuefeng Pan P, Jintao L, Yongdong Zhang Z, Sheng Tang T, Lejun Y (2007) Format-independent motion content description based on spatiotemporal visual sensitivity. IEEE Trans Consum Electron 53(2):769–774

    Article  Google Scholar 

  23. Yeo C, Ahammad P, Ramchandran K, Sastry S (2008) High speed action recognition and localization in compressed domain videos. IEEE Trans Circ Syst Video Technol 18(8):1006–1015

    Article  Google Scholar 

  24. Yi H, Rajan D, Chia L-T (2005) A new motion histogram to index motion content in video segments. Pattern Recognit Lett 26(9):1221–1231

    Article  Google Scholar 

  25. Zampoglou M, Papadimitriou T, Diamantaras KI (2007) Support vector machines content-based video retrieval based solely on motion information. IEEE Work Digit Object Identifier 176–180

  26. Zargari F, Mehrabi M, Ghanbari M (2010) Compressed domain texture based visual information retrieval method for I-frame coded frames. IEEE Trans Consum Electron 56(2):728–736

    Article  Google Scholar 

  27. Zhang D, Lu G (2003) Evaluation of similarity measurement for image retrieval. Int Conf Neural Netw Signal Process 2:928–931

    Google Scholar 

  28. Zhao J, Zhang Z, Han S, Qu C, Yuan Z, Zhang D (2011) SVM based forest fire detection using static and dynamic features. Comput Sci Inf Syst 8(3):821–841

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Farzad Zargari.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Akrami, F., Zargari, F. An efficient compressed domain video indexing method. Multimed Tools Appl 72, 705–721 (2014). https://doi.org/10.1007/s11042-013-1403-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1403-2

Keywords

Navigation