Abstract
This paper proposes a novel method to obtain the reliable edge and depth information by integrating a set of multi-focus images, i.e., a sequence of images taken by systematically varying a camera parameter focus. In previous work on depth measurement using focusing or defocusing, the accuracy depends upon the size and location of local windows where the amount of blur is measured. In contrast, no windowing is needed in our method; the blur is evaluated from the intensity change along corresponding pixels in the multi-focus images. Such a blur analysis enables us not only to detect the edge points without using spatial differentiation but also to estimate the depth with high accuracy. In addition, the analysis result is stable because the proposed method involves integral computations such as summation and least-square model fitting. This paper first discusses the fundamental properties of multi-focus images based on a step edge model. Then, two algorithms are presented: edge detection using an accumulated defocus image which represents the spatial distribution of blur, and depth estimation using a spatio-focal image which represents the intensity distribution along focus axis. The experimental results demonstrate that the highly precise measurement has been achieved: 0.5 pixel position fluctuation in edge detection and 0.2% error at 2.4 m in depth estimation.
Similar content being viewed by others
References
Asada, N. and Matsuyama, T. 1992. Color image analysis by varying camera aperture. In Proc. International Conference on Pattern Recognition, pp. A466-A469.
Asada, N., Fujiwara, H., and Matsuyama, T. 1995. Seeing behind the scene: Analysis of photometric properties of occluding edges by the reversed projection blurring model. In Proc. International Conference on Computer Vision, pp. 150-155.
Darrell, T. and Wohn, K. 1988. Pyramid based depth from focus. In Proc. Computer Vision and Pattern Recognition, pp. 504-509.
Ens, J. and Lawrence, P. 1993. An investigation of methods for determining depth from focus. IEEE Trans. on Pattern Analysis and Machine Intelligence, 15(2):97-108.
Grossmann, P. 1987. Depth from focus. Pattern Recognition Letters, 5:63-69.
Jarvis, R.A. 1983. A perspective on range finding technique for computer vision. IEEE Trans. on Pattern Analysis and Machine Intelligence, 5(2):122-139.
Krotkov, E. 1987. Focusing. International Journal of Computer Vision, 1(3):223-237.
Lai, S.H., Fu, C.W., and Chang, S. 1992. A generalized depth estimation algorithm with a single image. IEEE Trans. on Pattern Analysis and Machine Intelligence, 14(4):405-411.
Lighthart, G. and Groen, C.A. 1982. A comparison of different auto-focus algorithms. In Proc. International Conference on Pattern Recognition, pp. 597-600.
Nair, H.N. and Stewart, C.V. 1992. Robust focus ranging. In Proc. Computer Vision and Pattern Recognition, pp. 309-314.
Nayar, S.K. 1992. Shape from focus system for rough surface. In Proc. Image Understanding Workshop, pp. 539-606.
Pentland, A.P. 1987. A new sense for depth of field. IEEE Trans. on Pattern Analysis and Machine Intelligence, 9(4):523-531.
Subbarao, M. 1988. Parallel depth recovery by changing camera parameters. In Proc. International Conference on Computer Vision, pp. 149-155.
Subbarao, M. and Wei, T.C. 1992. Depth from defocus and rapid autofocusing: A practical approach. In Proc. Computer Vision and Pattern Recognition, pp. 773-776.
Subbarao, M., Wei, T.C., and Surya, G. 1994. Focused image recovery from two defocused images recorded with different camera settings. In Proc. Computer Vision and Pattern Recognition, pp. 786-791.
Xiong, Y. and Shafer, S.A. 1993. Depth from focusing and defocusing. In Proc. Computer Vision and Pattern Recognition, pp. 68- 73.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Asada, N., Fujiwara, H. & Matsuyama, T. Edge and Depth from Focus. International Journal of Computer Vision 26, 153–163 (1998). https://doi.org/10.1023/A:1007996810301
Issue Date:
DOI: https://doi.org/10.1023/A:1007996810301