Skip to main content
SpringerLink
Log in

Volumetric Scene Reconstruction from Multiple Views

  • Chapter
Foundations of Image Understanding

Part of the book series: The Springer International Series in Engineering and Computer Science ((SECS,volume 628))

Abstract

A review of methods for volumetric scene reconstruction from multiple views is presented. Occupancy descriptions of the voxels in a scene volume are constructed using shape-from-silhouette techniques for binary images, and shape-from-photo-consistency combined with visibility testing for color images.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. N. Ahuja and J. Veenstra. Generating octrees from object silhouettes in orthographic views. IEEE Trans. Pattern Analysis and Machine Intelligence, 11:137–149, 1989.

    Article  Google Scholar 

  2. A. H. Andersen and A. C. Kak. Simultaneous Algebraic Reconstruction Technique (SART): A superior implementation of the ART algorithm. Ultrasonic Imaging, 6:81–94, 1984.

    Article  Google Scholar 

  3. C. Baillard and A. Zisserman. A plane-sweep strategy for the 3D reconstruction of buildings from multiple images. In Proc. 19th ISP RS Congress and Exhibition, 2000.

    Google Scholar 

  4. S. Baker, R. Szeliski, and P. Anandan. A layered approach to stereo reconstruction. In Proc. Computer Vision and Pattern Recognition Conf., pages 434–441, 1998.

    Google Scholar 

  5. B. G. Baumgart. Geometric modeling for computer vision. Artificial Intelligence Laboratory Memo AIM-249, Stanford University, 1974.

    Google Scholar 

  6. P. A. Beardsley, P. H. S. Torr, and A. Zisserman. 3D model aquisition from extended image sequence. In B. Buxton and R. Cipolla, editors, Computer Vision — ECCV ′96 (Proc. 4th European Conf. on Computer Vision, volume II), volume 1065 of Lecture Notes in Computer Science, pages 683–695. Springer-Verlag, 1996.

    Google Scholar 

  7. A. Broadhurst and R. Cipolla. A statistical consistency check for the space carving algorithm. In Proc, 11th British Machine Vision Conf., pages 282–291, 2000.

    Google Scholar 

  8. Q. Chen and G. Medioni. A volumetric stereo matching method: Application to image-based modeling. In Proc. Computer Vision and Pattern Recognition Conf., volume 1, pages 29–34, 1999.

    Google Scholar 

  9. G. K. M. Cheung, T. Kanade, J-Y. Bouguet, and M. Holler. A real time system for robust 3D voxel reconstruction of human motions. In Proc. Computer Vision and Pattern Recognition Conf., volume 2, pages 714–720, 2000.

    Google Scholar 

  10. C. H. Chien and J. K. Aggarwal. Volume surface octrees for the representation of 3D objects. Computer Vision, Graphics and Image Processing, 36:100–113, 1986.

    Article  Google Scholar 

  11. R. Cipolla and A. Blake. Surface shape from the deformation of apparent contours. Intl. J. Computer Vision, 9:83–112, 1992.

    Article  Google Scholar 

  12. R. T. Collins. A space-sweep approach to true multi-image matching. In Proc. Computer Vision and Pattern Recognition Conf., pages 358–363, 1996.

    Google Scholar 

  13. S. Coorg and S. Teller. Extracting textured vertical facades from controlled close-range imagery. In Proc. Computer Vision and Pattern Recognition Conf., volume 1, pages 625–632, 1999.

    Google Scholar 

  14. G. Cross and A. Zisserman. Surface reconstruction from multiple views using apparent contours and surface texture. In A. Leonardis, F. Solina, and R. Bajcsy, editors, Confluence of Computer Vision and Computer Graphics, pages 25–47. Kluwer, 2000.

    Google Scholar 

  15. W. B. Culbertson, T. Malzbender, and G. Slabaugh. Generalized voxel coloring. In B. Triggs, A. Zisserman, and R. Szeliski, editors, Vision Algorithms: Theory and Practice (Proc. Intl. Workshop on Vision Algorithms), volume 1883 of Lecture Notes in Computer Science, pages 100–115. Springer-Verlag, 2000.

    Google Scholar 

  16. B. Curless and M. Levoy. A volumetric method for building complex models from range images. In Proc. SIGGRAPH, pages 303–312, 1996.

    Google Scholar 

  17. F. Dachille, K. Mueller, and A. Kaufman. Volumetric backprojection. In Proc. Volume Visualization and Graphics Symposium, pages 109–117, 2000.

    Google Scholar 

  18. J. S. DeBonet and P. Viola. Roxels: Responsibility weighted 3D volume reconstruction. In Proc. 7th Intl. Conf. on Computer Vision, pages 418–425, 1999.

    Google Scholar 

  19. P. Eisert, E. Steinbach, and B. Girod. Multi-hypothesis, volumetric reconstruction of 3-D objects from multiple calibrated camera views. In Proc. Intl. Conf. on Acoustics, Speech, and Signal Processing, pages 3509–3512, 1999.

    Google Scholar 

  20. O. Faugeras and R. Keriven. Complete dense stereovision using level set methods. In H. Burkhardt and B. Neumann, editors, Computer Vision — ECCV ′98 (Proc. 5th European Conf. on Computer Vision, volume I), volume 1406 of Lecture Notes in Computer Science, pages 379–393. Springer-Verlag, 1998.

    Google Scholar 

  21. D. T. Gering and W. M. Wells III. Object modeling using tomography and photography. In Proc. IEEE Workshop on Multi-View Modeling and Analysis of Visual Scenes, pages 11–18, 1999.

    Chapter  Google Scholar 

  22. S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen. The lumigraph. In Proc. SIGGRAPH, pages 43–54, 1996.

    Google Scholar 

  23. T. H. Hong and M. Shneier. Describing a robot’s workspace using a sequence of views from a moving camera. IEEE Trans. Pattern Analysis and Machine Intelligence, 7:721–726, 1985.

    Article  Google Scholar 

  24. S. S. Intille and A. F. Bobick. Disparity-space images and large occlusion stereo. In J-O. Eklundh, editor, Computer Vision — ECCV ′94 (Proc. 3rd European Conf. on Computer Vision, volume II), volume 801 of Lecture Notes in Computer Science, pages 179–186. Springer-Verlag, 1994.

    Google Scholar 

  25. M. Kimura, H. Saito, and T. Kanade. 3D voxel construction based on epipolar geometry. In Proc. Intl. Conf. on Image Processing, pages 135–139, 1999.

    Google Scholar 

  26. R. Koch, M. Pollefeys, and L. Van Gool. Multi viewpoint stereo from uncalibrated video sequences. In H. Burkhardt and B. Neumann, editors, Computer Vision — ECCV ′98 (Proc. 5th European Conf. on Computer Vision, volume I), volume 1406 of Lecture Notes in Computer Science, pages 55–71. Springer-Verlag, 1998.

    Google Scholar 

  27. K. N. Kutulakos. Shape from the light field boundary. In Proc. Computer Vision and Pattern Recognition Conf., pages 53–59, 1997.

    Google Scholar 

  28. K. N. Kutulakos. Approximate n-view stereo. In D. Vernon, editor, Computer Vision — ECCV 2000 (Proc. 6th European Conf. on Computer Vision, volume I), volume 1842 of Lecture Notes in Computer Science, pages 67–83. Springer-Verlag, 2000.

    Google Scholar 

  29. K. N. Kutulakos and S. M. Seitz. A theory of shape by space carving. Intl. J. of Computer Vision, 38:199–218, 2000.

    Article  MATH  Google Scholar 

  30. M. S. Langer and S. W. Zucker. Shape-from-shading on a cloudy day. J. Opt. Soc. Am. A, 11:467–478, 1994.

    Article  Google Scholar 

  31. A. Laurentini. The visual hull concept for silhouette-based image understanding. IEEE Trans. Pattern Analysis and Machine Intelligence, 16:150–162, 1994.

    Article  Google Scholar 

  32. A. Laurentini. How far 3D shapes can be understood from 2D silhouettes. IEEE Trans. Pattern Analysis and Machine Intelligence, 17:188–195, 1995.

    Article  Google Scholar 

  33. A. Laurentini. How many 2D silhouettes does it take to reconstruct a 3D object? Computer Vision and Image Understanding, 67:81–87, 1997.

    Article  Google Scholar 

  34. Y. G. Leclerc, Q-T. Luong, and P. Fua. Characterizing the performance of multiple-image point-correspondence algorithms using self-consistency. In B. Triggs, A. Zisserman, and R. Szeliski, editors, Vision Algorithms: Theory and Practice (Proc. Intl. Workshop on Vision Algorithms), volume 1883 of Lecture Notes in Computer Science, pages 100–115. Springer-Verlag, 2000.

    Google Scholar 

  35. Y. G. Leclerc, Q-T. Luong, and P. Fua. Measuring the self-consistency of stereo algorithms. In D. Vernon, editor, Computer Vision — ECCV 2000 (Proc. 6th European Conf. Computer Vision, volume II), volume 1842 of Lecture Notes in Computer Science, pages 282–298. Springer-Verlag, 2000.

    Google Scholar 

  36. W. E. Lorensen and H. E. Cline. Marching cubes: A high resolution 3D surface construction algorithm. In Proc. SIGGRAPH, pages 163–169, 1987.

    Google Scholar 

  37. W. N. Martin and J. K. Aggarwal. Volumetric description of objects from multiple views. IEEE Trans. Pattern Analysis and Machine Intelligence, 5:150–158, 1983.

    Article  Google Scholar 

  38. W. Matusik, C. Buehler, R. Raskar, S. J. Gortler, and L. McMillan. Image-based visual hulls. In Proc. SIGGRAPH, pages 369–374, 2000.

    Chapter  Google Scholar 

  39. M. Meissner, J. Huang, D. Bartz, K. Mueller, and R. Crawfis. A practical evaluation of popular volume rendering algorithms. In Proc. Volume Visualization and Graphics Symposium, pages 81–90, 2000.

    Google Scholar 

  40. S. Moezzi, A. Katkere, D. Kuramura, and R. Jain. Reality modeling and visualization from multiple video sequences. IEEE Computer Graphics and Applications, 16(6):58–63, 1996.

    Article  Google Scholar 

  41. S. Moezzi, L-C. Tai, and P. Gerard. Virtual view generation for 3D digital video. IEEE Multimedia, 4(1): 18–26, 1997.

    Article  Google Scholar 

  42. W. Niem. Error analysis for silhouette-based 3D shape estimation from multiple views. In Proc. Intl. Workshop on Synthetic-Natural Hybrid Coding and Three-Dimensional Imaging, 1997.

    Google Scholar 

  43. H. Noborio, S. Fukada, and S. Arimoto. Construction of the octree approximating three-dimensional objects by using multiple views. IEEE Trans. Pattern Analysis and Machine Intelligence, 10:769–782, 1988.

    Article  Google Scholar 

  44. M. Potmesil. Generating octree models of 3D objects from their silhouettes in a sequence of images. Computer Vision, Graphics and Image Processing, 40:1–20, 1987.

    Article  Google Scholar 

  45. A. C. Prock and C. R. Dyer. Towards real-time voxel coloring. In Proc. Image Understanding Workshop, pages 315–321, 1998.

    Google Scholar 

  46. H. Saito and T. Kanade. Shape reconstruction in projective grid space from large number of images. In Proc. Computer Vision and Pattern Recognition Conf., volume 2, pages 49–54, 1999.

    Google Scholar 

  47. S. M. Seitz and C. R. Dyer. Photorealistic scene reconstruction by voxel coloring. Intl. J. Computer Vision, 35:151–173, 1999.

    Article  Google Scholar 

  48. S. M. Seitz and K. N. Kutulakos. Plenoptic image editing. In Proc. 6th Intl. Conf. on Computer Vision, pages 17–24, 1998.

    Google Scholar 

  49. J. A. Sethian. Level Set Methods and Fast Marching Methods. Cambridge University Press, 2nd edition, 1999.

    Google Scholar 

  50. G. Slabaugh, B. Culbertson, T. Malzbender, and R. Schafer. Improved voxel coloring via volumetric optimization. Technical Report 3, Center for Signal and Image Processing, Georgia Institute of Technology, 2000.

    Google Scholar 

  51. G. Slabaugh, B. Culbertson, T. Malzbender, and R. Schafer. A survey of methods for volumetric scene reconstruction from photographs. Technical Report 1, Center for Signal and Image Processing, Georgia Institute of Technology, 2001.

    Google Scholar 

  52. G. G. Slabaugh, T. Malzbender, and W. B. Culbertson. Volumetric warping for voxel coloring on an infinite domain. In M. Pollefeys, L. Van Gool, A. Fitzgibbon, and A. Zisserman, editors, 3D Structure from Multiple Images of Large-Scale Environments and Applications to Virtual and Augmented Reality (Proc. SMILE 2000), Lecture Notes in Computer Science, pages 41–50. Springer-Verlag, 2001.

    Google Scholar 

  53. D. Snow, P. Viola, and R. Zabih. Exact voxel occupancy with graph cuts. In Proc. Computer Vision and Pattern Recognition Conf., volume 1, pages 345–352, 2000.

    Google Scholar 

  54. S. K. Srivastava and N. Ahuja. Octree generation from object silhouettes in perspective views. Computer Vision, Graphics and Image Processing, 49:68–84, 1990.

    Article  Google Scholar 

  55. R. Szeliski. Rapid octree construction from image sequences. CVGIP: Image Understanding, 58:23–32, 1993.

    Article  Google Scholar 

  56. R. Szeliski. Prediction error as a quality metric for motion and stereo. In Proc. 7th Intl. Conf. on Computer Vision, pages 781–788, 1999.

    Google Scholar 

  57. R. Szeliski. Stereo algorithms and representations for image-based rendering. In Proc. 10th British Machine Vision Conf., pages 314–328, 1999.

    Google Scholar 

  58. R. Szeliski and P. Golland. Stereo matching with transparency and matting. Intl. J. of Computer Vision, 32:45–61, 1999.

    Article  Google Scholar 

  59. R. Vaillant and O.D. Faugeras. Using extremal boundaries for 3D object modelling. IEEE Trans. Pattern Analysis and Machine Intelligence, 14:157–173, 1992.

    Article  Google Scholar 

  60. S. Vedula, S. Baker, S. Seitz, and T. Kanade. Shape and motion carving in 6D. In Proc. Computer Vision and Pattern Recognition Conf., volume 2, pages 592–598, 2000.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Wisconsin, USA

    Charles R. Dyer

Authors
  1. Charles R. Dyer
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. University of Maryland, USA

    Larry S. Davis

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer Science+Business Media New York

About this chapter

Cite this chapter

Dyer, C.R. (2001). Volumetric Scene Reconstruction from Multiple Views. In: Davis, L.S. (eds) Foundations of Image Understanding. The Springer International Series in Engineering and Computer Science, vol 628. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-1529-6_16

Download citation

  • DOI: https://doi.org/10.1007/978-1-4615-1529-6_16

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-5599-1

  • Online ISBN: 978-1-4615-1529-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation