Abstract
This chapter provides a general framework for multi-view and 3D video content acquisition. The device architecture is described as well with the camera post-processing stage, taking into account of the multi-view aspects. In addition, a depth-map computing stage is described in order to provide a complete specification of the multi-view content acquisition and preparation module. For the depth map extraction, different levels of quality can be achieved depending on the processing time. For monitoring purposes, the priority is given to the fastness although the depth information supposed to be used for the rendering, at client side, requires more computing in order to optimize the quality of the reconstructed views. In addition, in the multi-view context, a refinement step aims at enhancing the quality of the depth maps and optimizing the video coding performances. Finally, experimental results are presented in order to validate the different approaches through quality measurements of depth-based view reconstruction.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Smolic A (2011) 3D video and free viewpoint video-from capture to display. Pattern Recognit 44(9):1958–1968. [Online] http://dx.doi.org/10.1016/j.patcog.2010.09.005
Kubota A, Smolic A, Magnor M, Tanimoto M, Chen T, Zhang C (2007) Multiview imaging and 3DTV. IEEE Signal Process Mag 24(6):10–21
Matusik W, Pfister H (2004) 3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. ACM Trans Graph 23(3):814–824. [Online] http://doi.acm.org/10.1145/1015706.1015805
Tanimoto M (2010) FTV (Free-viewpoint TV). In: 17th IEEE international conference on image processing (ICIP), September 2010, pp 2393–2396. [Online] http://dx.doi.org/10.1109/ICIP.2010.5652084
Müller K, Smolic A, Dix K, Merkle P, Kauff P, Wiegand T (2008) View synthesis for advanced 3D video systems. EURASIP J Image Video Process 2008:1–11. [Online] http://dx.doi.org/10.1155/2008/438148
Scharstein D, Szeliski R (2002) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vis 47(1–3):7–42. [Online] http://dx.doi.org/10.1023/A:1014573219977
Tanimoto M, Fujii T, Panahpour M, Wildeboer M (2009) Depth estimation reference software DERS 5.0. ISO/IEC JTC1/SC29/WG11, Technical Report M16923
Hirschmuller H (2008) Stereo processing by semiglobal matching and mutual information. IEEE Trans Pattern Anal Mach Intell 30(2):328 –341
De Silva D, Fernando W, Kodikaraarachchi H, Worrall S, Kondoz A (2010) Adaptive sharpening of depth maps for 3D-TV. Electron Lett 46(23):1546–1548
Kang Y-S, Lee C, Ho Y-S (2008) An efficient rectification algorithm for multi-view images in parallel camera array. In: 3DTV Conference: the true vision - capture, transmission and display of 3D video, May 2008, pp 61–64. [Online] http://dx.doi.org/10.1109/3DTV.2008.4547808
Fusiello A, Trucco E, Verri A (2000) A compact algorithm for rectification of stereo pairs. Mach Vis Appl 12(1):16–22. [Online] http://dx.doi.org/10.1007/s001380050003
Reinhard E, Ashikhmin M, Gooch B, Shirley P (2001) Color transfer between images. IEEE Comput Graph Appl 21(5):34–41. [Online] http://dx.doi.org/10.1109/38.946629
Ruderman DL, Cronin TW, Chiao C-C (1998) Statistics of cone responses to natural images: implications for visual coding. J Opt Soc Am A 15(8):2036–2045. [Online] http://josaa.osa.org/abstract.cfm?URI=josaa-15-8-2036
Drazic V, Sabater N (2012) A precise real-time stereo algorithm. In: Proceedings of the 27th conference on image and vision computing New Zealand, ser. IVCNZ ’12. Association for Computing Machinery, New York, pp. 138–143. [Online] http://doi.acm.org/10.1145/2425836.2425867
Ekmekcioglu E, Velisavljevic V, Worrall S (2011) Content adaptive enhancement of multi-view depth maps for free viewpoint video. IEEE J Sel Top Signal Process 5(2):352–361
Bradski G, Kaehler A (2008) Learning OpenCV: computer vision with the OpenCV library. O’Reilly, Sebastopol
Telea A (2004) An image inpainting technique based on the fast marching method. J Graph Tools 9(1):23–34. [Online] http://www.tandfonline.com/doi/abs/10.1080/10867651.2004.10487596
Vetro A, Wiegand T, Sullivan G (2011) Overview of the stereo and multiview video coding extensions of the H.264/MPEG-4 AVC standard. Proc IEEE 99(4):626–642
H.264/AVC JM Reference Software (2008) Joint video team (JVT) of ISO/IEC MPEG & ITU-T VCEG. [Online] http://iphome.hhi.de/suehring/tml/, August 2008
Acknowledgments
This work was supported by the ROMEO project (grant number: 287896), which was funded by the EC FP7 ICT collaborative research program.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer Science+Business Media New York
About this chapter
Cite this chapter
Tizon, N., Dosso, G., Ekmekcioglu, E. (2014). Multi-view Acquisition and Advanced Depth Map Processing Techniques. In: Kondoz, A., Dagiuklas, T. (eds) 3D Future Internet Media. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8373-1_4
Download citation
DOI: https://doi.org/10.1007/978-1-4614-8373-1_4
Published:
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4614-8372-4
Online ISBN: 978-1-4614-8373-1
eBook Packages: EngineeringEngineering (R0)