Skip to main content
SpringerLink
Log in

Quality-Driven Coding and Prioritization of 3D Video over Wireless Networks

  • Chapter
High-Quality Visual Experience

Part of the book series: Signals and Communication Technology ((SCT))

Abstract

The introduction of more affordable and better quality 3D displays has increased the importance of designing efficient transmission systems for 3D video services. For achieving the best possible 3D video quality, it is necessary to take into account human perception issues to avoid potentially disturbing artifacts. These perception issues are considered in the design of the cross layer video adaptation and transmission system proposed in this work. One of the most popular formats for representing 3D video is color plus depth, where a 2D color video is supplemented with a depth map. The depth map represents the per pixel distance from the camera and can be used to render 3D video at the users terminal. The proposed scheme uses this depth information to segment the video into foreground and background parts. The foreground and background are then coded as separate video streams, whose data is prioritized according to its influence on video quality at the decoder. Received video quality is estimated by modeling the effect of packet loss and subsequent concealment. A home gateway scenario with IEEE 802.11e is simulated. The proposed 3D video distribution system exploits the different priority access classes to achieve high quality 3D video even with significant levels of packet loss, and high network loads. The simulations show that gains in PSNR of 1-3dB can be achieved, depending on the amount of activity within a particular video sequence. Subjective results are also obtained to demonstrate that the performance improvements are perceptible.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 179.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 229.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 279.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Takada, H., Suyama, S., Date, M., Ohtani, Y.: Protruding apparent 3D images in depth-fused 3D display. IEEE Trans.: Consumer Electronics 54, 233–239 (2008)

    Article  Google Scholar 

  2. Lee, C.M.G., Travis, A.R.L., Lin, R.: Flat-panel autostereoscopic 3D display. IET: Optoelectronics 2, 24–28 (2008)

    Article  Google Scholar 

  3. Stoykova, E., Alatan, A.A., Benzie, P., Grammalidis, N., Malassiotis, S., Ostermann, J., Piekh, S., Sainov, V., Theobalt, C., Thevar, T., Zabulis, X.: 3-D Time-Varying Scene Capture Technologies—A Survey. IEEE Trans.: Circuits and Sys. for Video Tech. 17, 1568–1586 (2007)

    Article  Google Scholar 

  4. Seung-Ryong, H., Toshihiko, Y., Kiyoharu, A.: 3D Video Compression Based on Extended Block Matching Algorithm. In: Proc. IEEE Int. Conf. on Image Processing (2006)

    Google Scholar 

  5. 3D@Home Consortium, http://www.3dathome.org/ (accessed June 02, 2009)

  6. Chang, Y.C., Lee, S.W., Komyia, R.: A fast forward error correction allocation algorithm for unequal error protection of video transmission over wireless channels. IEEE Trans.: Consumer Electronics 54, 1066–1073 (2008)

    Article  Google Scholar 

  7. Sprljan, N., Mrak, M., Izquierdo, E.: A fast error protection scheme for transmission of embedded coded images over unreliable channels and fixed packet size. In: Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (2005)

    Google Scholar 

  8. Van Der Schaar, M., Sai Shankar, N.: Cross-layer wireless multimedia transmission: challenges, principles, and new paradigms. IEEE Trans.: Wireless Comm. 12, 50–58 (2005)

    Google Scholar 

  9. Qiuyan, X., Xing, J., Hamdi, M.: Cross Layer Design for the IEEE 802.11 WLANs: Joint Rate Control and Packet Scheduling. IEEE Trans.: Wireless Comm. 6, 2732–2740 (2007)

    Article  Google Scholar 

  10. Villalon, J., Cuenca, P., Orozco-Barbosa, L., Seok, Y., Turletti, T.: Cross-Layer Architecture for Adaptive Video Multicast Streaming over Multi-Rate Wireless LANs. IEEE Trans.: IEEE Journal on Selected Areas in Communications 25, 699 (2007)

    Article  Google Scholar 

  11. Smolic, A., Kimata, H.: Applications and requirements for 3DAV. ISO. IEC JTC1/SC29/WG11 (2003)

    Google Scholar 

  12. Meesters, L.M.J., Ijsselsteijn, W.A., Seuntiens, P.: Survey of perceptual quality issues in threedimensional television systems. In: Proc. SPIE (2003)

    Google Scholar 

  13. Fehn, C.: A 3D-TV approach using depth-image-based rendering (DIBR). In: Proc. VIIP, Spain (2003)

    Google Scholar 

  14. Chen, Z., Han, J., Ngan, K.N.: Dynamic Bit Allocation for Multiple Video Object Coding. IEEE Trans.: Multimedia 8, 1117–1124 (2006)

    Article  Google Scholar 

  15. Chih-Wei, T., Ching-Ho, C., Ya-Hui, Y., Chun-Jen, T.: Visual sensitivity guided bit allocation for video coding. IEEE Trans.: Multimedia 8, 11–18 (2006)

    Article  Google Scholar 

  16. Perkins, M.G.: Data compression of stereopairs. IEEE Trans.: Comms. 40, 684–696 (1992)

    Article  Google Scholar 

  17. Aksay, A., Bilen, C., Kurutepe, E., Ozcelebi, T., Akar, G.B., Civanlar, M.R., Tekalp, A.M., Ankara, T.: Temporal and spatial scaling for stereoscopic video compression. In: Proc. IEEE EUSIPCO (2006)

    Google Scholar 

  18. Hewage, C.T.E.R., Worrall, S.T., Dogan, S., Kondoz, A.M.: Prediction of stereoscopic video quality using objective quality models of 2-D video. IET Electronics Letters 44, 963–965 (2008)

    Article  Google Scholar 

  19. Ekmekcioglu, E., Mrak, M., Worrall, S.T., Kondoz, A.M.: Edge adaptive upsampling of depth map videos for enhanced free-viewpoint video quality. IET Electronics Letters 45(7), 353–354 (2009)

    Article  Google Scholar 

  20. Cheng, I., Basu, A.: Perceptually optimized 3D transmission over wireless networks. In: Proc. International Conference on Computer Graphics and Interactive Techniques ACM SIGGRAPH, California (2005)

    Google Scholar 

  21. Draft Supplement to STANDARD FOR Telecommunications and Information Exchange Between Systems-LAN/MAN Specific Requirements - Part 11: Wireless Medium Access Control (MAC) and Physical Layer (PHY) specifications: Medium Access Control (MAC) Enhancements for Quality of Service. IEEE 802.11e/Draft 4.2, IEEE 802.11 WG (2003)

    Google Scholar 

  22. Deng, D.J., Chang, R.S.: A Priority Scheme for IEEE 802.11 DCF Access Method. IEICE Trans.: Comms. 82, 96–102 (1999)

    Google Scholar 

  23. Bystrom, M., Stockhammer, T.: Dependent source and channel rate allocation for video transmission. IEEE Trans.: Wireless Comm. 3, 258–268 (2004)

    Article  Google Scholar 

  24. van Dyck, R.E., Miller, D.J.: Transport of wireless video using separate, concatenated, and jointsource-channel coding. Proceedings of the IEEE 87, 1734–1750 (1999)

    Article  Google Scholar 

  25. Gharavi, H., Alamouti, S.M.: Video Transmission for Third Generation Wireless Communication Systems. Journal of research: National institute of standards and technology 106, 455–470 (2001)

    Google Scholar 

  26. Nasir, S., Worrall, S.T., Mrak, M., Kondoz, A.M.: An unequal error protection scheme for object based video communications. In: Proc. IEEE International Symposium on Consumer Electronics, Portugal (2008)

    Google Scholar 

  27. Dogan, S., Cellatoglu, A., yguroglu, M., Sadka, A.H., Kondoz, A.M.: Error-resilient video transcoding for robust internetwork communications using GPRS. IEEE Trans.: Circuits and Sys. for Video Tech. 12, 453–464 (2002)

    Article  Google Scholar 

  28. Ma, Y., Worrall, S.T., Kondoz, A.M.: Automatic Video Object Segmentation Using Depth Information and an Active Contour Model. In: Proc. Int. Conf. on Image Processing, San Diego, USA (2008)

    Google Scholar 

  29. ISO: Overview of the MPEG-4 Standard, ISO/IEC JTC/SC29/WG11 N4668 (2002)

    Google Scholar 

  30. Il-Min, K., Hyung-Myung, K.: An optimum power management scheme for wireless video service in CDMA systems. IEEE Trans.: Wireless Comm. 2, 81–91 (2003)

    Article  Google Scholar 

  31. Worrall, S.T., Fabri, S.N., Sadka, A.H., Kondoz, A.M.: Prioritisation of Data Partitioned MPEG-4 Video over Mobile Networks. ETT: Europ. Trans. on Telecom. 12, 169–174 (2001)

    Article  Google Scholar 

  32. Wang, Y., Wenger, S., Wen, J., Katsaggelos, A.K.: Error resilient video coding techniques. IEEE Signal Pro. Magazine 17, 61–82 (2000)

    Article  Google Scholar 

  33. Fall, K., Varadhan, K.: The ns manual, http://www.isi.edu/nsnam/ns/doc/index.html (accessed June 02, 2009)

  34. Ni, Q.: IEEE 802.11e NS2 Implementation, http://www.sop.inria.fr/planete/qni/Research.html (accessed June 02, 2009)

  35. Zitnick, C.L., Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: High-quality video view interpolation using a layered representation. ACM Transactions: Graphics (TOG) 23, 600–608 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Centre for Vision, Speech and Signal Processing, University of Surrey, Guildford, GU2 7XH, UK

    Sabih Nasir, Chaminda T. E. R. Hewage, Zaheer Ahmad, Marta Mrak, Stewart Worrall & Ahmet Kondoz

Authors
  1. Sabih Nasir
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chaminda T. E. R. Hewage
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zaheer Ahmad
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Marta Mrak
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Stewart Worrall
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ahmet Kondoz
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Surrey, Guildford, UK

    Marta Mrak

  2. University of Zagreb, Zagreb, Croatia

    Mislav Grgic

  3. Swiss Federal Institute of Technology, Lausanne, Switzerland

    Murat Kunt

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Nasir, S., Hewage, C.T.E.R., Ahmad, Z., Mrak, M., Worrall, S., Kondoz, A. (2010). Quality-Driven Coding and Prioritization of 3D Video over Wireless Networks. In: Mrak, M., Grgic, M., Kunt, M. (eds) High-Quality Visual Experience. Signals and Communication Technology. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12802-8_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12802-8_21

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12801-1

  • Online ISBN: 978-3-642-12802-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation