Skip to main content

The Use of Reality Models in Augmented Reality Applications

  • Conference paper
  • First Online:
3D Structure from Multiple Images of Large-Scale Environments (SMILE 1998)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1506))

Abstract

Augmented reality (AR) is a technology by which a user’s view of the real world is augmented with additional information from a computer model. AR applications require a very accurate model of the environment (a reality model) to augment the current view seamlessly with synthetic information (the virtual model). In this paper, we report on the problems we encountered with image data from real exterior construction sites. We discuss quality requirements for reality models in order to be useful in AR applications, and we outline potential further needs for reality models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A. Azarbayejani and A.P. Pentland. Recursive estimation of motion, structure, and focal length. IEEE Trans. on Pattern Analysis and Machine Intelligence (PAMI), 17(6):562–575, June 1995.

    Google Scholar 

  2. R.T. Azuma. A survey of augmented reality. Presence, Special Issue on Augmented Reality, 6(4):355–385, August 1997.

    Google Scholar 

  3. W. Barfield and T. Caudell. Augmented Reality and Wearable Computers. Lawrence Erlbaum Press, 1998.

    Google Scholar 

  4. J. Bowskill and J. Downie. Extending the capabilities of the human visual system: An introduction to enhanced reality. Computer Graphics, 29(2):61–65, 1995.

    Article  Google Scholar 

  5. D.E. Breen, E. Rose, and R.T. Whitaker. Interactive occlusion and collision of real and virtual objects in augmented reality. Technical Report ECRC-95-02, ECRC, Arabellastr. 17, D-81925 Munich, http://www.ecrc.de, 1995.

  6. S.E. Chen and L. Williams. View interpolation for image synthesis. In James T. Kajiya, editor, Computer Graphics (SIGGRAPH’ 93 Proceedings), volume 27, pages 279–288, August 1993.

    Google Scholar 

  7. CICC. Collaborative integrated communications for construction. ACTS AC-0017, 1995–1998, http://www.hhdc.bicc.com/cicc/, 1995.

  8. CUMULI. Computational Understanding of Multiple Images. Esprit LTR-21914, 1996–1999, http://www.inrialpes.fr/cumuli/, 1996.

  9. P.E. Debevec, C.J. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry-and image-based approach. In Proc. SIGGRAPH, pages 11–20, New Orleans, August 4–9 1996. ACM.

    Google Scholar 

  10. O. Faugeras, S. Laveau, L. Robert, G. Csurka, and C. Zeller. 3D reconstruction of urban scenes from sequences of images. In A. Gruen, O. Kuebler, and P. Agouris, editors, Automatic Extraction of Man-Made Objects from Aerial and Space Images. Birkhauser, 1995.

    Google Scholar 

  11. A. Fournier. Illumination problems in Computer Augmented Reality. Journee Analyse/Synthese d’Images (JASI), pages 1–21, January 1994.

    Google Scholar 

  12. S.J. Gortler, R. Grzeszczuk, R. Szeliski, and M.F. Cohen. The lumigraph. In Holly Rushmeier, editor, SIGGRAPH 96 Conference Proceedings, Annual Conference Series, pages 43–54. ACM SIGGRAPH, Addison Wesley, August 1996. held in New Orleans, Louisiana, 04–09 August 1996.

    Google Scholar 

  13. B.K.P. Horn and M.J. Brooks. Shape from Shading. MIT Press, Cambridge, MA, 1989.

    Google Scholar 

  14. T. Kanade, A. Yoshida, K. Oda, H. Kano, and M. Tanaka. A stereo machine for video-rate dense depth mapping and its new applications. In Proc. 15th Computer Vision and Pattern Recognition Conference (CVPR), San Francisco, June 18–20 1996. IEEE.

    Google Scholar 

  15. G. Klinker, D. Stricker, and D. Reiners. Augmented reality for exterior construction applications. In W. Barfield and T. Caudell, editors, Augmented Reality and Wearable Computers. Lawrence Erlbaum Press, 1998.

    Google Scholar 

  16. G.J. Klinker, K.H. Ahlers, D.E. Breen, P.-Y. Chevalier, C. Crampton, D.S. Greer, D. Koller, A. Kramer, E. Rose, M. Tuceryan, and R.T. Whitaker. Confluence of computer vision and interactive graphics for augmented reality. Presence: Teleoperators and Virtual Environments, special issue on Augmented Reality, 6(4):433–451, August 1997.

    Google Scholar 

  17. D. Koller, G. Klinker, E. Rose, D. Breen, R. Whitaker, and M. Tuceryan. Automated camera calibration and 3d egomotion estimation for augmented reality applications. In 7th Int’l Conf. on Computer Analysis of Images and Patterns (CAIP-97), Kiel, Germany, September 10–12, 1997, G. Sommer, K. Daniilidis, and J. Pauli (eds.), Lecture Notes in Computer Science 1296, Springer-Verlag, Berlin, Heidelberg, New York, 1997.

    Chapter  Google Scholar 

  18. M. Levoy and P. Hanrahan. Light field rendering. In Holly Rushmeier, editor, SIGGRAPH 96 Conference Proceedings, Annual Conference Series, pages 31–42. ACM SIGGRAPH, AddisonWesley, August 1996. held in New Orleans, Louisiana, 04–09 August 1996.

    Google Scholar 

  19. L. McMillan and G. Bishop. Plenoptic modeling: An image-based rendering system. In Robert Cook, editor, SIGGRAPH 95 Conference Proceedings, Annual Conference Series, pages 39–46. ACM SIGGRAPH, AddisonWesley, August 1995. held in Los Angeles, California, 06–11 August 1995.

    Google Scholar 

  20. J.P. Mellor. Realtime camera calibration for enhanced reality visualization. In Proc. of Computer Vision, Virtual Reality and Robotics in Medicine (CVRMed’ 95), pages 471–475, Nice, France, April 1995. IEEE.

    Google Scholar 

  21. P. Milgram and F. Kishino. A taxonomy of mixed reality visual displays. IEICE Transactions on Information Systems, E77-D(12), December 1994.

    Google Scholar 

  22. A. State, G. Hirota, D.T. Chen, W.F. Garrett, and M.A. Livingston. Superior augmented reality registration by integrating landmark tracking and magnetic tracking. In Proc. SIGGRAPH, pages 429–438, New Orleans, Aug 4–9 1996. ACM.

    Google Scholar 

  23. R. Szeliski and S.B. Kang. Recovering 3d shape and motion from image streams using non-linear least squares. Technical Report CRL 93/3, Cambridge Research Lab, Digital Equipment Corporation, One Kendall Square, Bldg. 700, March 1993.

    Google Scholar 

  24. M. Uenohara and T. Kanade. Vision-based object registration for real-time image overlay. In Proc. of Computer Vision, Virtual Reality and Robotics in Medicine (CVRMed’ 95), pages 13–22, Nice, France, April 1995. IEEE.

    Google Scholar 

  25. VANGUARD. Visualisation Across Networks using Graphics and Un-calibrated Acquisition of Real Data. ACTS AC-0074, 1995–1998, http://www.esat.kuleuven.ac.be/konijn/vanguard.html, 1995.

  26. G. Zachmann. Real-time and exact collision detection for interactive virtual prototyping. In Proc. of the 1997 ASME Design Engineering Technical Conferences, Sacramento, CA, Sept 14–17 1997. ASME. CIE-4306.

    Google Scholar 

  27. I. Zoghlami, O. Faugeras, and R. Deriche. Traitement des occlusions pour la modification d’objet plan dans une sequence d’image. Private communication; see also http://www.inria.fr/robotvis/personnel/zimad/orasis6/orasis6/html, 1996.

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Klinker, G., Stricker, D., Reiners, D. (1998). The Use of Reality Models in Augmented Reality Applications. In: Koch, R., Van Gool, L. (eds) 3D Structure from Multiple Images of Large-Scale Environments. SMILE 1998. Lecture Notes in Computer Science, vol 1506. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-49437-5_19

Download citation

  • DOI: https://doi.org/10.1007/3-540-49437-5_19

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-65310-3

  • Online ISBN: 978-3-540-49437-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics