Abstract
Cast shadows can be significant in many computer vision applications such as lighting-insensitive recognition and surface reconstruction. However, most algorithms neglect them, primarily because they involve non-local interactions in non-convex regions, making formal analysis difficult. While general cast shadowing situations can be arbitrarily complex, many real instances map closely to canonical configurations like a wall, a V-groove type structure, or a pitted surface. In particular, we experiment on 3D textures like moss, gravel and a kitchen sponge, whose surfaces include canonical cast shadowing situations like V-grooves. This paper shows theoretically that many shadowing configurations can be mathematically analyzed using convolutions and Fourier basis functions. Our analysis exposes the mathematical convolution structure of cast shadows, and shows strong connections to recently developed signal-processing frameworks for reflection and illumination. An analytic convolution formula is derived for a 2D V-groove, which is shown to correspond closely to many common shadowing situations, especially in 3D textures. Numerical simulation is used to extend these results to general 3D textures. These results also provide evidence that a common set of illumination basis functions may be appropriate for representing lighting variability due to cast shadows in many 3D textures. We derive a new analytic basis suited for 3D textures to represent illumination on the hemisphere, with some advantages over commonly used Zernike polynomials and spherical harmonics. New experiments on analyzing the variability in appearance of real 3D textures with illumination motivate and validate our theoretical analysis. Empirical results show that illumination eigenfunctions often correspond closely to Fourier bases, while the eigenvalues drop off significantly slower than those for irradiance on a Lambertian curved surface. These new empirical results are explained in this paper, based on our theory.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Basri, R., Jacobs, D.: Lambertian reflectance and linear subspaces. In: ICCV 2001, pp. 383–390 (2001)
Dana, K., Nayar, S.: Histogram model for 3d textures. In: CVPR 1998, pp. 618–624 (1998)
Dana, K., van Ginneken, B., Nayar, S., Koenderink, J.: Reflectance and texture of realworld surfaces. ACM Transactions on Graphics 18(1), 1–34 (1999)
Epstein, R., Hallinan, P., Yuille, A.: 5 plus or minus 2 eigenimages suffice: An empirical investigation of low-dimensional lighting models. In: IEEE 1995 Workshop Physics-Based Modeling in Computer Vision, pp. 108–116 (1995)
Hallinan, P.: A low-dimensional representation of human faces for arbitrary lighting conditions. In: CVPR 1994, pp. 995–999 (1994)
Koenderink, J., Doorn, A., Dana, K., Nayar, S.: Bidirectional reflection distribution function of thoroughly pitted surfaces. IJCV 31(2/3), 129–144 (1999)
Koenderink, J., van Doorn, A.: Phenomenological description of bidirectional surface reflection. JOSA A 15(11), 2903–2912 (1998)
Koudelka, M., Magda, S., Belhumeur, P., Kriegman, D.: Acquisition, compression, and synthesis of bidirectional texture functions. In: ICCV 2003 workshop on Texture Analysis and Synthesis (2003)
MacRobert, T.M.: Spherical harmonics; an elementary treatise on harmonic functions, with applications. Dover Publications, Mineola (1948)
Mallat, S.: A Wavelet Tour of Signal Processing. Academic Press, London (1999)
Malzbender, T., Gelb, D., Wolters, H.: Polynomial texture maps. In: SIGGRAPH 2001, pp. 519–528 (2001)
Oren, M., Nayar, S.: Generalization of lambert’s reflectance model. In: SIGGRAPH 1994, pp. 239–246 (1994)
Ramamoorthi, R.: Analytic PCA construction for theoretical analysis of lighting variability in images of a lambertian object. PAMI 24(10), 1322–1333 (2002)
Ramamoorthi, R., Hanrahan, P.: Analysis of planar light fields from homogeneous convex curved surfaces under distant illumination. In: SPIE Photonics West: Human Vision and Electronic Imaging VI, pp. 185–198 (2001)
Ramamoorthi, R., Hanrahan, P.: On the relationship between radiance and irradiance: Determining the illumination from images of a convex lambertian object. JOSAA 18(10), 2448–2459 (2001)
Ramamoorthi, R., Hanrahan, P.: A signal-processing framework for inverse rendering. In: SIGGRAPH 2001, pp. 117–128 (2001)
Sato, Y.: Illumination distribution from brightness in shadows: adaptive estimation of illumination distribution with unknown reflectance properties in shadow regions. In: ICCV 1999, pp. 875–882 (1999)
Sloan, P., Kautz, J., Snyder, J.: Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. ACM Transactions on Graphics (SIGGRAPH 2002) 21(3), 527–536 (2002)
Soler, C., Sillion, F.: Fast calculation of soft shadow textures using convolution. In: SIGGRAPH 1998, pp. 321–332 (1998)
Suen, P., Healey, G.: Analyzing the bidirectional texture function. In: CVPR 1998, pp. 753–758 (1998)
Torrance, K., Sparrow, E.: Theory for off-specular reflection from roughened surfaces. JOSA 57(9), 1105–1114 (1967)
Westin, S., Arvo, J., Torrance, K.: Predicting reflectance functions from complex surfaces. In: SIGGRAPH 1992, pp. 255–264 (1992)
Wolff, L., Nayar, S., Oren, M.: Improved diffuse reflection models for computer vision. IJCV 30, 55–71 (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ramamoorthi, R., Koudelka, M., Belhumeur, P. (2004). A Fourier Theory for Cast Shadows. In: Pajdla, T., Matas, J. (eds) Computer Vision - ECCV 2004. ECCV 2004. Lecture Notes in Computer Science, vol 3021. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24670-1_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-24670-1_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-21984-2
Online ISBN: 978-3-540-24670-1
eBook Packages: Springer Book Archive