Skip to main content
SpringerLink
Log in

Fast coding unit (CU) determination algorithm for high-efficiency video coding (HEVC) in smart surveillance application

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

High-efficiency video coding (HEVC) is a successor to the H.264/AVC standard as the newest video-coding standard using a quad-tree structure with the three block types of a coding unit (CU), a prediction unit (PU), and a transform unit (TU). This has become popular to apply to smart surveillance systems, because very high-quality image is needed to analyze and extract more precise features. On standard, the HEVC encoder uses all possible depth levels for determination of the lowest rate-distortion (RD) cost block. The HEVC encoder is more complex than the H.264/AVC standard. An efficient CU determination algorithm is proposed using spatial and temporal information in which 13 neighboring coding tree units (CTUs) are defined. Four CTUs are temporally located in the current CTU and the other nine neighboring CTUs are spatially situated in the current CTU. Based on the analysis of conditional probability values for SKIP and Merge modes, an optimal threshold value was determined for judging SKIP or Merge mode according to the CTU condition and an adaptive weighting factor. When SKIP or Merge modes were detected early, other mode searches were omitted. The proposed algorithm achieved approximately 35 % time saving with random-access configuration and 29 % time reduction with low-delay configuration while maintaining comparable rate-distortion performance, compared with HM 12.0 reference software.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Gubbi J, Buyyab R, Marusic S, Palaniswami M (2013) Internet of Things (IoT): a vision, architectural elements, and future directions. Future Gen Comput Syst 29:1645–1660

    Article  Google Scholar 

  2. Shu C-F, Hampapur A, Lu M, Brown L, Connell J, Senior A, Tian Y (2005) IBM smart surveillance system (S3): a open and extensible framework for event based surveillance. In: IEEE Conference on Advanced Video and Signal Based Surveillance, pp 318–323

  3. Cho Y, Lim SO, Yang HS (2010) Collaborative occupancy reasoning in visual sensor network for scalable smart video surveillance. IEEE Trans Consum Electron 56(3):1997–2003

    Article  Google Scholar 

  4. Nazare AC, dos Santos CE, Ferreira R, Robson Schwartz W (2014) Smart surveillance framework: a versatile tool for video analysis. In: IEEE Winter Conference on Applications of Computer Vision (WACV), pp 753–760

  5. Castro-Munoz G, Martinez-Carballido J (2015) Real time human action recognition using full and ultra high definition video. In: International Conference on Computational Science and Computational Intelligence (CSCI), pp 509–514

  6. Bross B, Han W-J, Sullivan GJ, Ohm J-R, Wiegand T (July 2012) High efficiency video coding (HEVC) text specification draft 8, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC) document JCTVC-J1003

  7. Sullivan GJ et al (2012) Overview of the high efficiency video coding (HEVC) standard. IEEE Trans Circuits Syst Video Technol 22(12):1649–1668

    Article  Google Scholar 

  8. Il-Koo K et al (2012) Block partitioning structure in the HEVC standard. IEEE Trans Circuits Syst Video Technol 22(12):1697–1706

    Article  Google Scholar 

  9. Chiang P-T, Chang TS (2013) Fast zero block detection and early CU termination for HEVC video coding. In: IEEE International Symposium on Circuits and Systems (ISCAS), pp 1640–1643

  10. Pan Z, Kwong S, Zhang Y, Lei J (2014) Fast coding tree unit depth decision for high efficiency video coding. In: IEEE International Conference on Image Processing (ICIP), pp 3214–3218

  11. Kibeya H, Belghith F, Ben Ayed MA, Masmoudi N (2014) A fast CU partitionning algorithm based on early detection of zero block quantified transform coefficients for HEVC standard. In: IEEE International Conference on Image Processing, Applications and Systems (IPAS), pp 1–5

  12. Schierl T, Hannuksela MM, Wang Y-K, Wenger S (2012) System layer integration of high efficiency video coding (HEVC). IEEE Trans Circuits Syst Video Technol 22(12):1871–1884

    Article  Google Scholar 

  13. Psannis KE, Hadjinicolaou M, Krikelis A (2006) MPEG-2 streaming of full interactive content. IEEE Trans Circuits Syst Video Technol 16(2):280–285

    Article  Google Scholar 

  14. Wenger S (2003) H.264/AVC over IP. IEEE Trans Circuits Syst 13(7):645–656

    Google Scholar 

  15. Stockhamme T, Hannuksela MM, Wiegand T (2003) H.264/AVC in wireless environments. IEEE Trans Circuits Syst Video Technol 13(7):657–673

    Article  Google Scholar 

  16. Psannis K, Ishibashi Y (2008) Efficient flexible macroblock ordering technique. IEICE Trans Commun E91–B(08):2692–2701

    Article  Google Scholar 

  17. Psannis KE (2015) HEVC in wireless environments. J Real Time Image Process. doi:10.1007/s11554-015-0514-6 (online published)

  18. Psannis K, Ishibashi Y (2006) Impact of video coding on delay and jitter in 3G wireless video multicast services. EURASIP J Wirel Commun Netw 2006, Article ID 24616, 1–7

  19. Zhang Y, Wang H, Li Z (2013) Fast coding unit depth decision algorithm for inter-frame coding in HEVC. In: Proceedings of Data Compression Conference, pp 53–62

  20. Shen L, Liu Z, Zhang X, Zhao W, Zhang Z (2013) An effective cu size decision method for HEVC encoders. IEEE Trans Multimed 15(2):465–470

    Article  Google Scholar 

  21. Choi K, Park S-H, Jang ES (2011) Coding tree prunning based CU early termination. Document JCTVC-F092, JCT-VC

  22. Yang J, Kim J, Won K, Lee H, Jeon B (2011) Early SKIP Detection for HEVC, document JCTVC-G543. JCV-VC, Geneva Switzerland

  23. Kim J, Jeong S, Cho K, Choi JS (2012) An efficient bi-prediction algorithm for HEVC. In: International Conference on Consumer Electronics (ICCE), Las Vegas

  24. Xiong J, Li H, Meng F, Zeng B, Zhu S, Wu Q (2014) Fast and efficient inter CU decision for high efficiency video coding In: Proceedings of IEEE International Conference Image Processing, pp 3715–3719

  25. Xiong J, Li H, Zhu S, Wu Q, Zeng B (2014) MRF-based fast HEVC inter CU decision with the variance of absolute differences. IEEE Trans Multimed 16(8):2141–2153

    Article  Google Scholar 

  26. Shen X, Yu L (2013) CU splitting early termination based on weighted SVM. EURASIP J Image Video Process 2013(1):1–11

    Article  Google Scholar 

  27. Cho S, Kim M (2013) Fast CU splitting and pruning for suboptimal CU partitioning in HEVC intra coding. IEEE Trans Circuits Syst Video Technol 23(9):1555–1564

    Article  Google Scholar 

  28. Xiong J, Li H, Wu Q, Meng F (2014) A fast HEVC inter CU selection method based on pyramid motion divergence. IEEE Trans Multimed 16(2):559–564

    Article  Google Scholar 

  29. Lee J, Kim S, Lim K, Lee S (2015) A fast CU size decision algorithm for HEVC. IEEE Trans Circuits Syst Video Technol 25(3):411–421

    Article  Google Scholar 

  30. Cassa M, Naccari M, Pereira F (2012) Fast rate distortion optimization for the emerging HEVC standard. In: Proceedings of Picture Coding Symposium (PCS), pp 493–496

  31. Lee B, Kim M (2011) Modeling rates and distortions based on a mixture of laplacian distributions for inter-predicted residues in quadtree coding of HEVC. IEEE Signal Process Lett 18(10):571–574

    Article  Google Scholar 

  32. Pan Z, Kwong S, Zhang Y, Lei J (2014) Fast coding tree unit depth decision for high efficiency video coding. In: IEEE International Conference of Image Processing (ICIP), pp 3214–3218

  33. Li X, Wien M, Ohm JR (2010) Rate-complexity-distortion evaluation for hybrid video coding. In: IEEE International Conference Multimedia and Expo, Singapore, July 19–23

  34. Bossen F (2012) Common test conditions and software reference configurations. Document JCTVC-I1100, JCT-VC, Geneva, Switzerland

  35. Sampaio F, Bampi S, Grellert M, Agostini L, Mattos J (2012) Motion vectors merging: low complexity prediction unit decision heuristic for the inter-prediction of HEVC encoders. In: International Conference on Multimedia and Expo (ICME), pp 657–662

  36. Yang S, Lee H, Shim HJ, Jeon B (2013) Fast inter mode decision process for HEVE encoder. In: The IEEE 11th Image, Video, and Multidimensional Signal Processing (IVMSP) Workshop, pp 1–4

Download references

Acknowledgments

This Research was supported by the Sookmyung Women’s University Research Grants (1-1603-2006).

Author information

Authors and Affiliations

  1. Department of IT Engineering, Sookmyung Women’s University, Seoul, Korea

    Byung-Gyu Kim

Authors
  1. Byung-Gyu Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Byung-Gyu Kim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, BG. Fast coding unit (CU) determination algorithm for high-efficiency video coding (HEVC) in smart surveillance application. J Supercomput 73, 1063–1084 (2017). https://doi.org/10.1007/s11227-016-1730-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-016-1730-y

Keywords

Search

Navigation