Abstract
In this paper, we present a method to enhance noisy depth maps using adaptive steering kernel regression based on distance transform. Data-adaptive kernel regression filters are widely used for image denoising by considering spatial and photometric properties of pixel data. In order to reduce noise in depth maps more efficiently, we adaptively refine the steering kernel regression function according to local region structures, flat and textured areas. In this work, we first generate two distance transform maps from the depth map and its corresponding color image. Then, the steering kernel is modified by a newly-designed weighing function directly related to joint distance transform. The weighting function expands the steering kernel in flat areas and shrinks it in textured areas toward local edges in the depth map. Finally, we filter the noise in the depth map with the refined steering kernel regression function. Experimental results show that our method outperforms the competing methods in objective and subjective comparisons for depth map enhancement.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Henry, P., Krainin, M., Herbst, E., Ren, X., Fox, D.: RGB-D Mapping: Using depth cameras for dense 3D modeling of indoor environments. In: Proc. of International Symposium on Experimental Robotics (2010)
Fehn, C., Barré, R., Pastoor, S.: Interactive 3-D TV- concepts and key technologies. Proceedings of the IEEE 94(3), 524–538 (2006)
Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., Blake, A.: Real-time human pose recognition in parts from single depth images. In: IEEE Conf. on Computer Vision and Pattern Recognition (2011)
Elad, M.: On the origin of the bilateral filter and ways to improve it. IEEE Trans. on Image Processing 11(10), 1141–1150 (2002)
Petschnigg, G., Agrawala, M., Hoppe, H., Szeliski, R., Cohen, M., Toyama, K.: Digital photography with flash and no-flash image pairs. ACM Trans. on Computer Graphics 23(3), 664–672 (2004)
Riemens, A.K., Gangwal, O.P., Barenbrug, B., Berretty, R.M.: Multi-step joint bilateral depth upsampling. In: Proc. of Electronic Imaging, Visual Communications and Image Processing, pp. 1–12 (2009)
Takeda, H., Farsiu, S., Milanfar, P.: Deblurring using regularized locally-adaptive kernel regression. IEEE Trans. on Image Processing 17(4), 550–563 (2008)
Borgefors, G.: Hierarchical chamfer matching: a parametric edge matching algorithm. IEEE Trans. on Patten Analysis and Machine Intelligence 10(6), 849–865 (1988)
Feng, X., Milanfar, P.: Multiscale principal components analysis for image local orientation estimation. In: Proc. of Asilomar Conference on Signals, Systems and Computers, pp. 478–482 (2002)
Scharstein, D., Szeliski, R.: A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Jour. of Computer Vision 47(1-3), 7–42 (2002)
Lee, E.K., Ho, Y.S.: Generation of high-quality depth maps using hybrid camera system for 3-D video. Jour. of Visual Communication and Image Representation 22, 73–84 (2011)
Kim, S.Y., Lee, S.B., Ho, Y.S.: Three-dimensional natural video system based on layered representation of depth maps. IEEE Trans. on Consumer Electronics 52(3), 1035–1042 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, SY., Cho, W., Koschan, A., Abidi, M.A. (2011). Depth Map Enhancement Using Adaptive Steering Kernel Regression Based on Distance Transform. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2011. Lecture Notes in Computer Science, vol 6938. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24028-7_27
Download citation
DOI: https://doi.org/10.1007/978-3-642-24028-7_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24027-0
Online ISBN: 978-3-642-24028-7
eBook Packages: Computer ScienceComputer Science (R0)