Abstract
In the last few years, the miniaturization of projectors has gained certain momentum. Today, projectors are available that can easily fit into the palm of a hand. Moreover, these devices are even being integrated into mobile phones. Mobile projectors allow users to project digital imagery into physical space virtually anywhere and anytime. The unique characteristics of small-scale projectors open up interesting opportunities for mobile user interface research. This article provides a comprehensive overview of research on mobile projected user interfaces according to three pertinent research directions: (i) nomadic, (ii) handheld, and (iii) tangible projection interfaces. Furthermore, the article outlines future research challenges and indicates trends in neighboring research fields that might foster innovation in the mobile projected user interfaces domain.
Similar content being viewed by others
References
AAXA Technologies (2013) P2 Jr. Pico Projector. http://www.aaxatech.com/products/p2jr_pico_projector.html, last access: 1. November 2013
AAXA Technologies (2013) P3 Pico Projector. http://www.aaxatech.com/products/p3_pico_projector.htm, last access: 1. November 2013
AAXA Technologies (2013) L1 Laser Pico Projector. http://www.aaxatech.com/products/l1_laser_pico_projector.htm, last access: 1. November 2013
Ballendat T, Marquardt N, Greenberg S (2010) Proxemic interaction: designing for a proximity and orientation-aware environment. In: ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 121–130
Cao X, Balakrishnan R (2006) Interacting with dynamically defined information spaces using a handheld projector and a pen. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 225–234
Cao X, Forlines C, Balakrishnan R (2007) Multi-user interaction using handheld projectors. In: Proceedings of the 20th annual ACM symposium on User interface software and technology. ACM, pp 43–52
Cauchard JR, Fraser M, Han T, Subramanian S (2012) Steerable projection: exploring alignment in interactive mobile displays. Pers Ubiquitous Comput 16(1):27–37
Cowan LG, Li KA (2011) ShadowPuppets: supporting collocated interaction with mobile projector phones using hand shadows. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 2707–2716
Cowan LG, Weibel N, Griswold WG, Pina LR, Hollan JD (2012) Projector phone use: practices and social implications. Pers Ubiquitous Comput 16(1):53–63
Dachselt R, Häkkilä J, Jones M, Löchtefeld M, Rohs M, Rukzio E (2012) Pico projectors: firefly or bright future? Interactions 19(2):24–29
Dachselt R, Jones M, Häkkilä J, Löchtefeld M, Rohs M, Rukzio E (2011) Mobile and personal projection (MP2). In: CHI ’11 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 21–23
Dachselt R, Sarmad A-S (2011) Interacting with Printed Books Using Digital Pens and Smart Mobile Projection MP2 Workshop at CHI 2011
Global Industry Analysts (2011) Inc. Pico Projectors – A Global Strategic Business Report. http://www.strategyr.com/Pico_Projectors_Market_Report.asp, last access: 1. November 2013
Hang A, Rukzio E, Greaves A (2008) Projector phone: a study of using mobile phones with integrated projector for interaction with maps. In: Proceedings of the 10th international conference on Human computer interaction with mobile devices and services. ACM, pp 207–216
Hardy J, Alexander J (2012) Toolkit support for interactive projected displays. In: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia. ACM, pp 42:1–42:10
Harrison C, Benko H, Wilson AD (2011) OmniTouch: wearable multitouch interaction everywhere. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 441–450
Harrison C, Ramamurthy S, Hudson SE (2012) On-body interaction: armed and dangerous. In: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, pp 69–76
Harrison C, Tan D, Morris D (2010) Skinput: appropriating the body as an input surface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 453–462
Holman D, Vertegaal R, Altosaar M, Troje N, Johns D (2005) Paper windows: interaction techniques for digital paper. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 591–599
Huber J, Liao C, Steimle J, Liu Q (2011) Toward bimanual interactions with mobile projectors on arbitrary surfaces. In: Proc. MP2: Workshop on Mobile and Personal Projection, pp 10–12
Huber J, Steimle J, Liao C, Liu Q, Mühlhäuser M (2012) LightBeam: interacting with augmented real-world objects in pico projections. In: Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia, vol. 16. ACM, pp 1–10
Kane SK, Avrahami D, Wobbrock JO et al (2009) Bonfire: a nomadic system for hybrid laptop-tabletop interaction. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology. ACM, pp 129–138
Liao C, Tang H, Liu Q, Chiu P, Chen F (2010) FACT: fine-grained cross-media interaction with documents via a portable hybrid paper-laptop interface. In: Proceedings of the International Conference on Multimedia. ACM, pp 361–370
Linder N, Maes P (2010) LuminAR: portable robotic augmented reality interface design and prototype Adjunct. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology. ACM, pp 395–396
Lissermann R, Huber J, Steimle J, Mühlhäuser M (2013) Permulin: collaboration on interactive surfaces with personal in- and output. In: CHI ’13 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 1533–1538
Löchtefeld M, Gehring S, Jung R, Krüger A (2011) Using mobile projection to support guitar learning. In: Dickmann L, Volkmann G, Malaka R, Boll S, Krüger A, Olivier P (eds) Smart graphics. Springer, Berlin Heidelberg, pp 103–114
Löchtefeld M, Schöning J, Rohs M, Krüger A (2009) Marauders light: replacing the wand with a mobile camera projector unit. In: Proceedings of the 8th International Conference on Mobile and Ubiquitous Multimedia. ACM, pp 19:1–19:4
Microvision (2013) SHOWWX+ Laser Pico Projector. http://www.microvision.com/showwxplus_hdmi/, last access: 1. November 2013
Milgram P, Kishino FA (1994) Taxonomy of mixed reality visual displays. IEICE Trans Inform Syst 77(12):1321–1329
Mistry P, Maes P, Chang L (2009) WUW – wear Ur world: a wearable gestural interface. In: CHI ’09 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 4111–4116
Mistry P (2009) ThirdEye: a technique that enables multiple viewers to see different content on a single display screen. In: ACM SIGGRAPH ASIA 2009 Posters. ACM, pp 29:1–29:1
Molyneaux D, Gellersen H, Finney J (2013) Cooperative augmentation of mobile smart objects with projected displays. ACM T Interact Intell Syst 3(2):7:1–7:35
Molyneaux D, Gellersen H, Schiele B (2008) Vision-based detection of mobile smart objects. In: Roggen D, Lombriser C, Tröster G, Kortuem G, Havinga P (eds) Smart sensing and context. Springer, Berlin Heidelberg, pp 27–40
Molyneaux D, Gellersen H (2009) Projected interfaces: enabling serendipitous interaction with smart tangible objects. In: Proceedings of the 3rd International Conference on Tangible and Embedded Interaction. ACM, pp 385–392
Molyneaux D, Izadi S, Kim D et al (2012) Interactive environment-aware handheld projectors for pervasive computing spaces. In: Kay J, Lukowicz P, Tokuda H, Olivier P, Krüger A (eds) Pervasive computing. Springer, Berlin Heidelberg, pp 197–215
Naimark M (2005) Two unusual projection spaces. Presence-Teleop Virt 14(5):597–605
Rapp S, Michelitsch G, Osen M et al (2004) Spotlight navigation: interaction with a handheld projection device International conference on pervasive computing, video paper.
Raskar R, van Baar J, Beardsley P, Willwacher T, Rao S, Forlines C (2006) iLamps: geometrically aware and self-configuring projectors ACM SIGGRAPH 2006 Courses. In: ACM SIGGRAPH 2006 Papers. ACM
Raskar R, Beardsley P, van Baar J et al (2004) RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors. In: ACM SIGGRAPH 2004 Papers. ACM, pp 406–415
Robinson S, Jones M, Vartiainen E, Marsden G (2012) PicoTales: collaborative authoring of animated stories using handheld projectors. In: Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, pp 671–680
Rukzio E, Holleis P, Gellersen H (2012) Personal projectors for pervasive computing. IEEE Pervasive Comput 11(2):30–37
Rukzio E, Schöning J, Rohs M, Häkkilä J, Dachselt R (2012) Theme issue on personal projection. Pers Ubiquitous Comput 16(1):1–3
Schöning J, Rohs M, Kratz S, Löchtefeld M, Krüger A (2009) Map torchlight: a mobile augmented reality camera projector unit. In: CHI ’09 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 3841–3846
Sodhi R, Poupyrev I, Glisson M, Israr A (2013) AIREAL: interactive tactile experiences in free air. ACM Trans Graph 32(4):134:1–134:10
Song H, Grossman T, Fitzmaurice G et al (2009) PenLight: combining a mobile projector and a digital pen for dynamic visual overlay. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 143–152
Song H, Guimbretiere F, Grossman T, Fitzmaurice G (2010) MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 2451–2460
Steimle J, Jordt A, Maes P (2013) Flexpad: highly flexible bending interactions for projected handheld displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 237–246
Underkoffler J, Ullmer B, Ishii H (1999) Emancipated pixels: real-world graphics in the luminous room. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques. ACM Press/Addison-Wesley Publishing Co., pp 385–392
Weigel M, Boring S, Marquardt N, Steimle J, Greenberg S, Tang A (2013) From focus to context and back: combining mobile projectors and stationary displays. In: Proceedings of GRAND 2013
Weigel M, Boring S, Steimle J, Marquardt N, Greenberg S, Tang A (2013) ProjectorKit: easing rapid prototyping of interactive applications for mobile projectors. In: Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services. ACM, pp 247–250
Willis KD (2012) A pre-history of handheld projector-based interaction. Pers Ubiquitous Comput 16(1):5–15
Willis KDD, Poupyrev I, Hudson SE, Mahler M (2011) SideBySide: ad-hoc multi-user interaction with handheld projectors. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 431–440
Willis KDD, Poupyrev I, Shiratori T (2011) Motionbeam: a metaphor for character interaction with handheld projectors. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, pp 1031–1040
Willis KDD, Shiratori T, Mahler M (2013) HideOut: mobile projector interaction with tangible objects and surfaces. In: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction. ACM, pp 331–338
Wilson AD, Benko H (2010) Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In: Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology. ACM, pp 273–282
Wilson ML, Craggs D, Robinson S, Jones M, Brimble K (2012) Pico-ing into the future of mobile projection and contexts. Pers Ubiquitous Comput 16(1):39–52
Winkler C, Pfeuffer K, Rukzio E (2012) Investigating mid-air pointing interaction for projector phones. In: Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 85–94
Winkler C, Reinartz C, Nowacka D, Rukzio E (2011) Interactive phone call: synchronous remote collaboration and projected interactive surfaces. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 61–70
Winkler C, Seifert J, Reinartz C, Krahmer P, Rukzio E (2013) Penbook: bringing pen+paper interaction to a tablet device to facilitate paper-based workflows in the hospital domain. In: Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces. ACM, pp 283–286
Xiao R, Harrison C, Willis KDD, Poupyrev I, Hudson SE (2013) Lumitrack: low cost, high precision, high speed tracking with projected m-sequences. In: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology. ACM, pp 3–12
Ye Z, Khalid H (2010) Cobra: flexible displays for mobile gaming scenarios. In: CHI ’10 Extended Abstracts on Human Factors in Computing Systems. ACM, pp 4363–4368
Zhao Y, Xue C, Cao X, Shi Y (2011) PicoPet: “Real World” digital pet on a handheld projector. In: Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology. ACM, pp 1–2
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Huber, J. A Research Overview of Mobile Projected User Interfaces. Informatik Spektrum 37, 464–473 (2014). https://doi.org/10.1007/s00287-014-0819-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00287-014-0819-z