Skip to main content
SpringerLink
Log in

Improved motion estimation time using a combination of dynamic reference frame selection and residue-based mode decision

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Motion estimation using multiple reference frames is widely used as the basis for recent video coding standards (eg. H.264/AVC) to achieve increased coding efficiency. However, this increases the complexity of the encoding process. In this paper, a new technique for efficient motion estimation is proposed. A combination of multiple reference frame selection and image residue-based mode selection is used to improve motion estimation time. By dynamic selection of an initial reference frame in advance, the number of reference frames to be considered is reduced. In addition, from examination of the residue between the current block and reconstructed blocks in preceding frames, variable block size mode decisions are made. Modified initial motion vector estimation and early stop condition detection are also adopted to speed up the motion estimation procedure. Experimental results compare the performance of the proposed algorithm with a state of the art motion estimation algorithm and demonstrate significantly reduced motion estimation time while maintaining PSNR performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Joint Video Team Software JM13.1 [Online] Available: http://iphoome.hhi.de/suehring/tml

  2. Anderson J., Giannakis G.: Image motion estimation algorithms using cumulants. IEEE Trans. Image Process 4(3), 346–357 (1995)

    Article  Google Scholar 

  3. Bailo G., Bariani M., Barbieri I., Raggio M.: Search window size decision for motion estimation algorithm in H.264 video coder. IEEE Int. Conf. Image process 3, 1453–1456 (2004)

    Google Scholar 

  4. Chang A., Au O.C., Yeung Y.M.: A novel approach to fast multi-frame selection for H.264 video coding. Proc. IEEE Int. Symp. Circuits Syst. 2, 704–707 (2003)

    Google Scholar 

  5. Chen L.G., Chen W.T., Jehng Y.S., Chiuch T.D.: An efficient parallel motion estimation algorithm for digital image processing. IEEE Trans. Circuits Syst. Video Technol. 1(4), 378–385 (1991)

    Article  Google Scholar 

  6. Chen M.J., Li G.L., Chiang Y.Y., Hsu C.T.: Fast multiframe motion estimation algorithms by motion vector composition for the MPEG-4/AVC/H.264 standard. IEEE Trans. Multimedia 8(3), 478–487 (2006)

    Article  Google Scholar 

  7. Cheung C.H., Po L.M.: Novel cross-diamond-hexagonal search algorithms for fast block motion estimation. IEEE Trans. Multimedia 7(1), 16–22 (2005)

    Article  Google Scholar 

  8. Fan C., Namazi N., Penafiel P.: A new image motion estimation algorithm based on the em technique. IEEE Trans. Patt. Anal. Mach. Intell. 18(3), 348–352 (1996)

    Article  Google Scholar 

  9. Ghanbari M.: The cross-search algorithm for motion estimation. IEEE Trans. Commun. 38(7), 950–953 (1990)

    Article  Google Scholar 

  10. Goel, S., Ismail, Y., Bayoumi, M.A.: Adaptive search window size algorithm for fast motion estimation in H.264/AVC standard. In: The 48th Midwest Symposium on Circuits and System, vol. 2, pp. 1557–1560 (2005)

  11. Huang Y.W., Hsieh B.Y., Chien S.Y., Ma S.Y., Chen L.G.: Analysis and complexity reduction of multiple reference frames motion estimation in H.264/AVC. IEEE Trans. Circuits Syst. Video Technol. 16(4), 507–522 (2006)

    Article  Google Scholar 

  12. Kim S.E., Han J.K., Kim J.G.: An efficient scheme for motion estimation using multireference frames in H.264/AVC. IEEE Trans. Multimedia 8(3), 457–466 (2006)

    Article  Google Scholar 

  13. Koga, K., Iinuma, K., Hirano, A., Ishiguro, T.: Motion compensated interframe coding for video conferencing. In: Proceedings of National Telecommunication Conference, vol. 86, pp. G5.3.1–G5.3.5. New Orleans, LA (1981)

  14. Kuo T.Y., Chan C.H.: Fast variable block size motion estimation for H.264 using likelihood and correlation of motion field. IEEE Trans. Circuits Syst. Video Technol. 16(10), 1185–1195 (2006)

    Article  Google Scholar 

  15. Li H., Roivainen P., Forchheimer R.: 3-d motion estimation in model-based facial image coding. IEEE Trans. Patt. Anal. Mach. Intell. 15(6), 545–555 (1993)

    Article  Google Scholar 

  16. Li, H.J., Hsu, C.T., Chen, M.J.: Fast multiple reference frame selection method for motion estimation in JVT/H.264. In: The 2004 IEEE Asia-Pacific Conference on Circuits and System, vol. 1, pp. 605–608 (2004)

  17. Li, X., Li, E.Q., Chen, Y.K.: Fast multi-frame motion estimation algorithm with adaptive search strategies in H.264. In: Proceedings of International Conference on Acoustics, Speech, and Signal Processing, vol. 3, pp. 369–372. Quebec, Canada (2004)

  18. Nie Y., Ma K.K.: Adaptive rood pattern search for fast block-matching motion estimation. IEEE Trans. Image Process. 11(12), 1442–1449 (2002)

    Article  Google Scholar 

  19. Ostermann J., Bormans J., List P., Marpe D., Narroschke M., Pereira F., Stockhammer T., Wedi T.: Video coding with H.264/AVC: tools, performance, and complexity. IEEE Circuits Syst. Mag. 4(1), 7–28 (2004)

    Article  Google Scholar 

  20. Park, I., Capson, D.W.: Dynamic reference frame selection for improved motion estimation time in H.264/AVC. In: Proceedings of IEEE Southwest Symposium on Image Analysis and Interpretation, pp. 97–100. Santa Fe, NM, USA (2008)

  21. Park, I., Capson, D.W.: Improved inter mode decision based on residue in H.264/AVC. In: Proceedings of the IEEE International Conference on Multimedia and Expo, pp. 709–712. Hanover, Germany (2008)

  22. Po L.M., Ma W.C.: A novel four-step search algorithm for fast block motion estimation. IEEE Trans. Circuits Syst. Video Technol. 6(3), 313–317 (1996)

    Article  Google Scholar 

  23. Rijkse K.: H.263: video coding for low-bit-rate communication. IEEE Commun. Mag. 34(12), 42–45 (1996)

    Article  Google Scholar 

  24. Shen L., Liu Z., Zhang Z., Wang G.: An adaptive and fast multiframe selection algorithm for H.264 video coding. IEEE Signal Process. Lett. 14(11), 836–839 (2007)

    Article  Google Scholar 

  25. Strintzis M., Kokkinidis I.: Maximum likelihood motion estimation in ultrasound image sequences. IEEE Signal Process. Lett. 4(6), 156–157 (1997)

    Article  Google Scholar 

  26. Su Y., Sun M.T.: Fast multiple reference frame motion estimation for H.264/AVC. IEEE Trans. Circuits Syst. Video Technol. 16(3), 447–452 (2006)

    Article  Google Scholar 

  27. Ting, C.W., Po, L.M., Cheung, C.H.: Center-biased frame selection algorithms for fast multi-frame motion estimation in H.264. In: Proceedings IEEE International Conference on Neural Networks and Signal Processing, vol. 2, pp. 1258–1261. Nanjing, China (2003)

  28. Weng J., Cohen P., Rebibo N.: Motion and structure estimation from stereo image sequences. IEEE Trans. Robot. Autom. 8(3), 362–382 (1992)

    Article  Google Scholar 

  29. Wiegand T., Sullivan G.J., Bjntegaard G., Luthra A.: Overview of the H.264/AVC video coding standard. IEEE Trans. Circuits Syst. Video Technol. 13(7), 560–576 (2003)

    Article  Google Scholar 

  30. Wu, D., Wu, S., Lim, P.P., Pan, F., Li, Z.G., Lin, X.: Block inter mode decision for fast encoding of H.264. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 3, pp. 181–184. Quebec, Canada (2004)

  31. Yang L., Yu K., Li J., Li S.: An effective variable block-size early termination algorithm for H.264 video coding. IEEE Trans. Circuits Syst. Video Technol. 15(9), 784–788 (2005)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Computational Engineering and Science, McMaster University, 1280 Main Street West, Hamilton, ON, L8S 4K1, Canada

    Insu Park & David W. Capson

Authors
  1. Insu Park
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. David W. Capson
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Insu Park.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Park, I., Capson, D.W. Improved motion estimation time using a combination of dynamic reference frame selection and residue-based mode decision. SIViP 6, 25–39 (2012). https://doi.org/10.1007/s11760-010-0169-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-010-0169-5

Keywords

Search

Navigation