Skip to main content
Log in

Using Mobile Code to Create Ubiquitous Augmented Reality

  • Published:
Wireless Networks Aims and scope Submit manuscript

Abstract

Augmented reality systems supplement reality by adding virtual objects into a real-world view. In this article, we describe a flexible mobile code approach for implementing ubiquitous, active, and mobile augmented reality systems. We will concentrate primarily on solving the problem of how to acquire the data for the virtual objects in a way that will be flexible and expandable enough to be used in ubiquitous computing. To clarify the concepts and to illustrate our current research status, we will present an example system that provides virtual user interfaces for various real-world objects. We also hope that these interfaces provide useful insights to the possibilities that our approach can provide. This article suggests that the mobile code approach offers a relatively simple solution that is flexible, scales well, and does not require the computing equipment attached to the real-world objects to be excessively complicated. We can use the same approach in applications that provide only simple descriptions of the real-world objects and in complex applications that allow the user to manipulate real-world objects via virtual user interfaces that exist only in augmented reality. Our approach also supports active augmented reality, in which the virtual objects can react to the real-world events.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. I.D. Agranat, Engineering web technologies for embedded applications, IEEE Internet Computing (May–June 1998) 40–45.

  2. R.T. Azuma, A survey of augmented reality, Presence 6(4) (August 1997) 355–385.

    Google Scholar 

  3. M. Billinghurst, J. Bowskill, M. Jessop and J. Morphett, A wearable spatial conferencing space, in: Proc. 2nd Int. Symp. on Wearable Computers (ISCW'98), Pittsburgh, PA (1998).

  4. M. Billinghurst, S. Weghorst and T. Furness III, Wearable computers for three dimensional cscw, in: Proc. of the 1st Int. Symposium on Wearable Computers (ISCW'97), Cambridge, MA (1997).

  5. D.M. Chess, Security issues in mobile code systems, in: Mobile Agents and Security (LNCS 1419), ed. G. Vigna (Springer-Verlag, 1998) pp. 1–14.

  6. Elektrobit Ltd., DT10 Sequence radio modem, http://www.elektrobit.fi/products/sequence.html

  7. S. Feiner, B. MacIntyre, M. Haupt and E. Solomon, Windows on the world: 2d windows for 3d augmented reality, in: Proc. ACM Symp. on User Interface Software and Technology (UIST'93), Atlanta, GA (1993) pp. 145–155.

  8. S. Feiner, B. MacIntyre, T. Hollerer and A. Webster, A touring machine: Prototyping 3d mobile augmented reality systems for exploring the urban environment, in: Proc. 1st Int. Symp. on Wearable Computers (ISWC'97), Cambridge, MA (1997).

  9. S. Feiner, B. MacIntyre and D. Sellgmann, Knowledge-based augmented reality, Communications of the ACM 36(7) (July 1993) 53–62.

    Google Scholar 

  10. S. Fickas, G. Kortuem and Z. Segall, Software organization for dynamic and adaptable wearable systems, in: Proc. 1st Int. Symp. on Wearable Computers (ISWC'97), Cambridge, MA (1997).

  11. A. Fuggetta, G.P. Picco and G. Vigna, Understanding code mobility, IEEE Transactions on Software Engineering 24(5) (May 1998) 342–361.

    Google Scholar 

  12. J. Haartsen, M. Naghshineh, J. Inouye, O.J. Joeressen and W. Allen, Bluetooth: Visions, goals, and architecture, ACM Mobile Computing and Communications Review 2(4) (October 1998) 38–45.

    Google Scholar 

  13. T.D. Hodes, R.H. Katz, E. Servan-Schreiber and L. Rowe, Composable ad-hoc mobile services for universal interaction, in: Proc. 3rd Annual ACM/IEEE Int. Conf. on Mobile Computing and Networking (MOBICOM'97), Budapest, Hungary (1997) pp. 1–12.

  14. Home Audio/Video Interoperability, HAVi, http://www.havi. org/home.html

  15. IBM Corp., Aglets Software Development Kit, http://www.trl. ibm.co.jp/aglets/

  16. R. Itschner, C. Pommerell and M. Rutishauser, Glass: Remote monitoring of embedded systems in power engineering, IEEE Internet Computing (May–June 1998) 46–52.

  17. K. Kangas and J. Röning, Using mobile code interfaces to control ubiquitous embedded systems, in: Proc. USENIX Embedded System Workshop (ES'99), Cambridge, MA (1999).

  18. K. Kangas and J. Röning, Using mobile code and the Internet to implement value-added services for ubiquitous embedded systems, in: Proc. 12th ISCA Int. Conf. on Parallel and Distributed Computing Systems (PDSC'99), Fort Lauderdale, FL (1999).

  19. K. Kangas and J. Röning, Using mobile code for service integration in ubiquitous computing, in: 5th Mobile Object Systems Workshop (MOS'99), Lisboa, Portugal (1999) http://cuiwww.unige.ch/~ecoopws/ws99/

  20. G. Kortuem, Z. Segall and M. Bauer, Adaptive computers as remote interfaces to intelligent environments, in: Proc. 2nd Int. Symp. on Wearable Computers (ISCW'98), Pittsburgh, PA (1998).

  21. B. Krupczak, K.L. Calvert and M.H. Ammar, Implementing communication protocols in Java, IEEE Communications Magazine (October 1998) 93–99.

  22. S. Mann, Wearable computing: A first step toward personal imaging, Computer (February 1997) 25–32.

  23. P. Milgram, S. Zhai, D. Drascic and J.J. Grodski, Applications of augmented reality for human–robot communication, in: Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS'93), Yokohama, Japan (1993) pp. 1467–1472.

  24. ObjectSpace, Inc., Voyager, http://www.objectspace.com/developers/voyager/

  25. T. Ohshima, K. Satoh, H. Yamamoto and H. Tamura, Ar2hockey: A case study of collaborative augmented reality, in: Proc. Virtual Reality Annual Int. Symp. (VRAIS'98), Atlanta, GA (1998).

  26. P. Pulli, T. Pyssysalo, K. Kuutti, J. Similä, J.-P. Metsävainio and O. Komulainen, Cyphone – mobile multimodal personal augmented reality, in: Proc. 2nd Int. Conf. on Worldwide Computing and Its Applications (WWCA'98), Tsukuba, Japan (1998) pp. 326–336.

  27. A. Puliafito, O. Tomarchio, L. Vita and K.S. Trivedi, Increasing application accessibility through Java, IEEE Internet Computing (July–August 1998) 70–77.

  28. J. Rekimoto, Navicam: A magnifying glass approach to augmented reality, Presence 6(4) (August 1997) 399–412.

    Google Scholar 

  29. J. Rekimoto, Y. Ayatsuka and K. Hayashi, Augmentable reality: Situated communication through physical and digital spaces, in: Proc. 2nd Int. Symp. on Wearable Computers (ISCW'98), Pittsburgh, PA (1998).

  30. T. Richardson, Q. Stafford-Fraser, K.R. Wood and A. Hopper, Virtual network computing, IEEE Internet Computing (January–February 1998) 33–38.

  31. A. Smailagic and R. Martin, Metronaut: A wearable computer with sensing and global communication capabilities, in: Proc. 1st Int. Symp. on Wearable Computers (ISWC'97), Cambridge, MA (1997).

  32. M.B. Spitzer, N.M. McClelland and P. Aquilino, Eyeglass-based systems for wearable computing, in: Proc. 1st Int. Symp. on Wearable Computers (ISWC'97), Cambridge, MA (1997).

  33. M. Spreitzer and M. Theimer, Providing location information in a ubiquitous computing environment, in: Proc. 14th ACM Symp. on Operating Systems Principles (SIGOPS'93), Asheville, NC (1993) pp. 270–283.

  34. T. Starner, S. Mann, B. Rhodes, J. Levine, J. Healey, D. Kirsch, R.W. Picard and A. Pentland, Augmented reality through wearable computing, Presence 6(4) (August 1997) 386–398.

    Google Scholar 

  35. A. State, M.A. Livingstone, W.F. Garrett, G. Hirota, M.C. Whitton, E.D. Pisano and H. Fuchs, Technologies for augmented reality systems: Realizing ultrasound-guided needle biobsies, in: Proc. 23rd Conf. on Computer Graphics (SIGGRAPH'96), New Orleans, LA (1996) pp. 439–446.

  36. Sun Microsystems, Inc., Java Communications API, http://www.javasoft.com/products/javacomm/

  37. Sun Microsystems, Inc., Jini, http://www.sun.com/jini/

  38. R. Want, A. Hopper, V. Falcao and J. Gibbons, The Active Badge location system, ACM Transactions on Information Systems 10(1) (January 1992) 91–102.

    Google Scholar 

  39. A. Webster, S. Feiner, B. MacIntyre, W. Massie and T. Krueger, Augmented reality in architectural construction, inspection, and renovation, in: Proc. 3rd ASCE Congress on Computing in Civil Engineering, Anaheim, CA (1996).

  40. M. Weiser, The computer for the 21st century, Scientific American (September 1991) 66–75.

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kangas, K.J., Röning, J. Using Mobile Code to Create Ubiquitous Augmented Reality. Wireless Networks 8, 199–211 (2002). https://doi.org/10.1023/A:1013720010326

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1013720010326

Navigation