Abstract
Ray-space representation is the main technology to realize free viewpoint video system with complicated scenes. Ray-space interpolation is one of key problems to be solved. A new fast ray-space interpolation method that can preserve depth discontinuity is proposed in this paper. Discontinuity features of ray-space data are first extracted by using adaptive threshold, then, a cross check operation is carried out between neighboring epipolar lines to refine the extracted feature points. After that, ray directions of feature points are determined, and ray-space interpolation is implemented in the regions segmented by feature points. Experimental results show that the proposed method achieves much higher PSNR than the pixel matching based interpolation method and the block matching based interpolation method, and the quality of rendered intermediate viewpoint images is also improved greatly. In addition, the proposed interpolation method requires low computational cost and is suitable for hardware implementation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Takano, T., Naemura, T., Harashima, H.: 3D Space Coding Using Virtual Object Surface. Systems and Computers 32, 47–59 (2001)
Smolic, A., Kamata, H.: Report on Status of 3DAV Exploration. ISO/IEC JTC1/SC29/WG11 N5558 (2003)
Smolic, A., Kimata, H.: Report on 3DAV Exploration. ISO/IEC JTC1/SC29/WG11 N5878 (2003)
Bangchang, P.N., Fujii, T., Tannimoto, M.: Experimental System of Free Viewpoint Television. In: Proc. of SPIE, Stereoscopic Displays and Virtual Reality Systems, Australia, vol. 5006, pp. 554–564 (2003)
Kobayashi, T., Fujii, T., Kimoto, T.: Interpolation of Ray-Space Data by Adaptive Filtering. In: Proc. of SPIE, Electronic Imaging, vol. 3958, pp. 252–259 (2000)
Tehrani, M.P., Fujii, T., Tanimoto, M.: Offset Block Matching of Multi-View Images for Ray-Space Interpolation. The journal of the Institute of Image information and Television Engineers 58, 540–548 (2004)
Kimata, H., Kitahara, M., Kamikura, K.: System Design of Free Viewpoint Video Communication. In: The Fourth International Conference on Computer and Information Technology, Wuhan, China, pp. 52–59 (2004)
Fan, L., Jiang, G., Yu, M.: Realization of FTV Based on Ray Space Representation. Journal of Computer-Aided Design & Computer Graphics (to appear)
Fujii, T., Tanimoto, M.: Acquisition and display systems of FTV (Free-viewpoint TeleVision). In: Proc. of SPIE, Three Dimensional TV, Video and Display, Japan, vol. 5243, pp. 96–103 (2003)
Droese, M., Fujii, T., Tanimoto, M.: Ray-Space Interpolation based on Filtering in Disparity Domain. In: Proc. of 3D Image Conference 2004, Tokyo, Japan (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jiang, G., Fan, L., Yu, M., Ye, X., Wang, R., Kim, YD. (2005). Fast Ray-Space Interpolation with Depth Discontinuity Preserving for Free Viewpoint Video System. In: Ho, YS., Kim, H.J. (eds) Advances in Multimedia Information Processing - PCM 2005. PCM 2005. Lecture Notes in Computer Science, vol 3767. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11581772_36
Download citation
DOI: https://doi.org/10.1007/11581772_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30027-4
Online ISBN: 978-3-540-32130-9
eBook Packages: Computer ScienceComputer Science (R0)