Skip to main content
SpringerLink
Log in

Multimodal Interactions: Embedding New Meanings to Known Forms and Objects

  • Conference paper
  • First Online:
Internet of Things. IoT Infrastructures (IoT360 2015)

Included in the following conference series:

Abstract

The way we are experiencing and interacting with our everyday living environment define and anticipate our future behavior and actions. Today new digital technologies vastly diminish boundaries between virtual and physical world. Cross-reality design supported with recent mobile and context aware computing, gradually changed the concept of user interaction and moved it more toward usage of heterogeneous contexts, pervasive computing technologies, and multimodal spatial perception and transformed our living surroundings into smart environments, traditional living object into smart living objects. Ubiquitous computing vision implies more than ever to our lives. In order to make all these changes more human-centered in this paper we are investigated the cognitive and metaphorical aspects of future interface design strategies which could enhance user experience and ideas acceptance, communicated through multimodal interactions. In this paper we are presenting three tangible interfaces that we have developed for design and research purposes and results we collected during their public exposure. Hopefully, the results will give us sufficient insights for further investigations in the field of smart living environments and smart objects development. We believe that to fulfill these goals application and exploration of tangible interfaces frameworks and cognitive methods could be one of the crucial elements for the future research success.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Weiser, M., Brown, J.S.: The coming age of calm technology. In: Denning, P.J., Metcalfe, R.M. (eds.) Beyond Calculation: The Next Fifty Years of Computing. Copernicus, Göttingen (1998)

    Google Scholar 

  2. Muller, J., Alt, F., Michelis, D. (eds.): Pervasive Advertising, pp. 1–30. Springer, Berlin (2011)

    Book  Google Scholar 

  3. Van Waart, P., Mulder, I., De Bont, C.: Meaningful advertising. In: Muller, J., Alt, F., Michelis, D. (eds.) Pervasive Advertising, pp. 57–79. Springer, Berlin (2011)

    Chapter  Google Scholar 

  4. Coleman, B.: Using sensor inputs to affect virtual and real environments. IEEE Pervasive Comput. 8(3), 16–23 (2009)

    Article  Google Scholar 

  5. Dindar, N., Balkesen, C., Kromwijk, K., Tatbul, N.: Event processing support for cross-reality environments. IEEE Pervasive Comput. Mag. 8(3), 34–41 (2009). Special Issue on Cross-Reality Environment

    Article  Google Scholar 

  6. Fitzmaurice, G., Ishii, H., Buxton, W.: Bricks: laying the foundations for graspable user interfaces. In: Proceedings of the CHI 1995 Conference on Human Factors in Computing Systems, Denver, Colorado, pp. 442–449 (1995)

    Google Scholar 

  7. Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits, and atoms. In: Proceedings of the CHI 1997 Conference on Human Factors in Computing Systems, Atlanta, Georgia, pp. 234–241 (1997)

    Google Scholar 

  8. Feiner, S., MacIntyre, B., Hollerer, T.: A touring machine: prototyping 3D mobile augmented reality systems for exploring the urban environment. In: Proceedings of the 1st International Symposium Wearable Computers (ISWC 1997), pp. 74–81. IEEE, CS Press (1997)

    Google Scholar 

  9. Mark, G.: Extreme collaboration. Commun. ACM 45(6), 89–93 (2002)

    Article  Google Scholar 

  10. Lifton, J., Laibowitz, M., Harry, D., Gong, N., Mittal, M., Paradiso, J.: Metaphor and manifestation: cross reality with ubiquitous sensor/actuator networks. IEEE Pervasive Comput. Mag. 8, 24–33 (2009)

    Article  Google Scholar 

  11. Askay, S.: New visualization tools for environmental sensor networks: using Google earth as an interface to micro-climate and multimedia datasets. Master’s thesis, Department Environmental Sciences, University of California, Riverside (2006)

    Google Scholar 

  12. Reilly, D., Voida, S., McKeon, M., Le Dantec, C., Edwards, W.K., Mynatt, E., Mazalek, A.: Space matters: physical-digital and physical-virtual co-design, in the inspace project. IEEE Pervasive Comput. 9(3), 54–63 (2010)

    Article  Google Scholar 

  13. Mistree, B.F.T., Paradiso, J.A.: ChainMail – a configurable multimodal lining to enable sensate surfaces and interactive objects. In: Proceedings of TEI 2010, pp. 65–72 (2010)

    Google Scholar 

  14. Reilly, D., Tang, A., Wu, A., Echenique, A., Massey, J., Mathiasen, N., Mazalek, A., Edwards, W.K.: Organic UIs and cross-reality spaces. In: 2nd International Workshop on Organic User Interfaces (OUI 2011), TEI 2011, Madeira, Portugal (2011)

    Google Scholar 

  15. Nardi, B. (ed.): Context and Consciousness: Activity Theory and Human-Computer Interaction. MIT Press, Cambridge (1996)

    Google Scholar 

  16. Leont’ev, A.N.: Activity, Consciousness, Personality. Prentice Hall, Englewood Cliffs (1978)

    Google Scholar 

  17. Engeström, Y.: Learning, Working and Imagining: Twelve Studies in Activity Theory. Orienta-Konsultit Oy, Helsinki (1990)

    Google Scholar 

  18. Hinckley, K., Pausch, R., Goble, J.C., Kassell, N.F.: Passive real-world interface props for neurosurgical visualization. In: Proceedings of the CHI 1994 Conference on Human Factors in Computing Systems, Boston, Massachusetts, pp. 452–458 (1994)

    Google Scholar 

  19. Harrison, B., Fishkin, K., Want, R., Gujar, A., Mochon, C.: Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. In: Proceedings of the CHI 1998 Conference on Human Factors in Computing Systems, Los Angeles, California, pp. 17–24 (1998)

    Google Scholar 

  20. Fishkin, K., Moran, T., Harrison, B.: Embodied user interfaces: towards invisible user interfaces. In: Chatty, S., Dewan, P. (eds.) Engineering for Human–Computer Interaction, pp. 1–18. Springer Science + Business Media, New York (1998)

    Google Scholar 

  21. Ullmer, B., Ishii, H.: Emerging frameworks for tangible user interfaces. In: Carroll, J.M. (ed.) Human–Computer Interaction in the New Millennium, pp. 579–601. Addison-Wesley, New York (2001)

    Google Scholar 

  22. Fishkin, K.P.: A taxonomy for and analysis of tangible interfaces. J. Pers. Ubiquit. Comput. 8(5), 347–358 (2004)

    Google Scholar 

  23. Mithen, S.: The Prehistory of the Mind. Thames and Hudson, London (1996)

    Google Scholar 

  24. Brown, T.: Making Truth: Metaphor in Science. University of Illinois Press, Champaign (2003)

    Google Scholar 

  25. Kuhn, T.S.: Metaphor in science. In: Ortony, A. (ed.) Metaphor and Thought, 2nd edn, pp. 1–539. Cambridge University Press, Cambridge (1993)

    Google Scholar 

  26. Goldin-Meadow, S.: Structure in a manual communication system developed without a conventional language model: language without a helping hand. In: Whitaker, H., Whitaker, H.A. (eds.) Studies in Neurolinguistics, vol. 4, pp. 125–209. Academic Press, New York (1979)

    Chapter  Google Scholar 

  27. Goldin-Meadow, S.: The representation of semantic relations in a manual language created by deaf children of hearing parents: a language you can’t dismiss out of hand. Ph.D. thesis (1975)

    Google Scholar 

  28. Gorbet, M.: Beyond input devices: a new conceptual framework for the design of physical–digital objects. Masters thesis, MIT Media Laboratory, Cambridge, Massachusetts (1998)

    Google Scholar 

  29. Kuhn, D.: The Skills of Argument. Cambridge University Press, Cambridge (1991)

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Digital Production, EDUCONS University, Vojvode Putnika 87, 21208, Sremska Kamenica, Serbia

    Predrag K Nikolic

Authors
  1. Predrag K Nikolic
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Predrag K Nikolic .

Editor information

Editors and Affiliations

  1. IBM Research , Haifa, Israel

    Benny Mandler

  2. CONNECT Centre, Trinity College, University of Dublin, Dublin, Ireland

    Johann Marquez-Barja

  3. GTA/PEE-COPPE/DEL-Poli, Universidade Federal do Rio de Janeiro (UFRJ), Rio de Janeiro, Rio de Janeiro, Brazil

    Miguel Elias Mitre Campista

  4. Faculty of Materials Science and Technology in Trnava, Slovak University of Technology in Bratislava, Trnava, Slovakia

    Dagmar Cagáňová

  5. Institut Télécom SudParis , Evry, France

    Hakima Chaouchi

  6. College of Communication and Information, University of Kentucky, Lexington, Kentucky, USA

    Sherali Zeadally

  7. College of Technological Innovation, Zayed University, Dubai, United Arab Emirates

    Mohamad Badra

  8. University of Pisa, Pisa, Holy See (Vatican City State)

    Stefano Giordano

  9. DICIEAMA Department, University of Messina, Messina, Italy

    Maria Fazio

  10. CREATE-NET , Trento, Italy

    Andrey Somov

  11. University of Trento , Trento, Italy

    Radu-Laurentiu Vieriu

Rights and permissions

Reprints and permissions

Copyright information

© 2016 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Nikolic, P.K. (2016). Multimodal Interactions: Embedding New Meanings to Known Forms and Objects. In: Mandler, B., et al. Internet of Things. IoT Infrastructures. IoT360 2015. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 170. Springer, Cham. https://doi.org/10.1007/978-3-319-47075-7_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-47075-7_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-47074-0

  • Online ISBN: 978-3-319-47075-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation