Skip to main content

Investigating Narrative and Performative Sound Design Strategies for Interactive Commodities

  • Conference paper
Auditory Display (CMMR 2009, ICAD 2009)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5954))

Abstract

Computing technologies turn everyday artefacts into narrative, procedural objects. This observation suggests that the narrative sound design strategies used in films and many video games could also be applied for the design of interactive commodities. However, it is unknown whether these strategies from immersive media can be applied in physical artefacts of everyday use. In this paper we describe methodological considerations and outline a structure of a revisable, design oriented, participatory research process, which allows to explore narrative sound designs and their possible application in interactive commodities in a systematic yet explorative way. The process, which focused on interpretational aspects, has been applied in two workshops and their results are reported and discussed. The experience of the prototyping and evaluation method, which made use of theatrical strategies, raised important questions about the role of performativity in the emergence of meaning and the possible limitations of a strictly hermeneutic aesthetics, when dealing with sonically enhanced interactive commodities.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Franinovic, K., Hug, D., Visell, Y.: Sound embodied: Explorations of sonic interaction design for everyday objects in a workshop setting. In: Proceedings of the 13th international conference on Auditory Display (2007)

    Google Scholar 

  2. Barras, S.: Earbenders: Using stories about listening to design auditory interfaces. In: Proceedings of the First Asia-Pacific Conference on Human Computer Interaction APCHI 1996, Information Technology Institute, Singapore (1996)

    Google Scholar 

  3. Hug, D.: Towards a hermeneutics and typology of sound for interactive commodities. In: Proceedings of the CHI 2008 Workshop on Sonic Interaction Design, Firenze (2008)

    Google Scholar 

  4. Hug, D.: Genie in a bottle: Object-sound reconfigurations for interactive commodities. In: Proceedings of Audiomostly 2008, 3rd Conference on Interaction With Sound (2008)

    Google Scholar 

  5. Csikszentmihalyi, M., Rochberg-Halton, E.: The meaning of things - Domestic symbols and the self. Cambridge University Press, Cambridge (1981)

    Google Scholar 

  6. Vastokas, J.M.: Are artifacts texts? Lithuanian woven sashes as social and cosmic transactions. In: Riggins, S.H. (ed.) The Socialness of Things - Essays on the Socio-Semiotics of Objects, pp. 337–362. Mouton de Gruyter, Berlin (1994)

    Google Scholar 

  7. McCarthy, J., Wright, P., Wallace, J.: The experience of enchantment in human-computer interaction. Personal Ubiquitous Comput. 10, 369–378 (2006)

    Article  Google Scholar 

  8. Chion, M.: Audio-Vision: sound on screen. Columbia University Press, New York (1994)

    Google Scholar 

  9. van Leeuwen, T.: Speech, Music, Sound. Palgrave Macmillan, Houndmills and London (1999)

    Google Scholar 

  10. Flückiger, B.: Sounddesign: Die virtuelle Klangwelt des Films. Schüren Verlag, Marburg (2001)

    Google Scholar 

  11. Sonnenschein, D.: Sound Design - The Expressive Power of Music, Voice, and Sound Effects in Cinema. Michael Wiese Productions, Studio City (2001)

    Google Scholar 

  12. LoBrutto, V.: Sound-on-film: Interviews with creators of film sound, Praeger, Westport, CT (1994)

    Google Scholar 

  13. Viers, R.: The Sound Effects Bible. Michael Wiese Productions, Studio City (2008)

    Google Scholar 

  14. Schafer, R.M.: The Soundscape: Our Sonic Environment and the Tuning of the World, 2nd edn., 1994 edn. Destiny Books, New York (1977)

    Google Scholar 

  15. Chion, M.: Le Son, Editions Nathan, Paris (1998)

    Google Scholar 

  16. Truax, B.: Acoustic Communication, 2nd edn. Greenwood Press, Westport (2001)

    Google Scholar 

  17. Goffman, E.: The Goffman Reader. Blackwell, Malden (1997)

    Google Scholar 

  18. Melles, G.: An enlarged pragmatist inquiry paradigm for methodological pluralism in academic design research. Artifact 2(1), 3–11 (2008)

    Article  Google Scholar 

  19. Morse, J.M.: Principles of mixed methods and multimethod research design. In: Tashakkori, A., Teddle, C. (eds.) Handbook of Mixed Methods In Social and Behavioral Research, Sage, Thousand Oaks (2003)

    Google Scholar 

  20. Charmaz, K.: Constructing Grounded Theory: A Practical Guide Through Qualitative Analysis, Thousand Oaks (2006)

    Google Scholar 

  21. McCarthy, J., Wright, P.: Technology as Experience. MIT Press, Massachusetts (2004)

    Google Scholar 

  22. Gray, A.: Research Practice for Cultural Studies. Sage, London (2003)

    Google Scholar 

  23. Brix, A.: Solid knowledge: Notes on the nature of knowledge embedded in designed artefacts. Artifact 2(1), 36–40 (2008)

    Article  Google Scholar 

  24. Zimmerman, J., Forlizzi, J.: The role of design artifacts in design theory construction. Artifact 2(1), 41–45 (2008)

    Article  Google Scholar 

  25. Krippendorff, K.: The semantic turn - A new foundation for design. Taylor & Francis, Abington (2006)

    Google Scholar 

  26. Zimmerman, J., Forlizzi, J., Evenson, S.: Research through design as a method for interaction design research in hci. In: Proceedings of the Conference on Human Factors in Computing Systems, pp. 493–502. ACM Press, New York (2007)

    Google Scholar 

  27. Buchenau, M., Suri, J.F.: Experience prototyping. In: Proceedings of the Conference on Designing Interactive Systems, Brooklyn, New York, pp. 424–433 (2000)

    Google Scholar 

  28. Kelley, J.F.: An iterative design methodology for user-friendly natural language office information applications. ACM Transactions on Office Information Systems 2(1), 26–41 (1984)

    Article  MathSciNet  Google Scholar 

  29. Droumeva, M., Wakkary, R.: The role of participatory workshops in investigating narrative and sound ecologies in the design of an ambient intelligence auditory display. In: Proceedings of the 12th International Conference on Auditory Display, London, UK (2006)

    Google Scholar 

  30. Laurel, B.: Design improvisation - ethnography meets theatre. In: Laurel, B. (ed.) Design Research - Methods and Perspectives. MIT Press, Cambridge (2003)

    Google Scholar 

  31. Carroll, J.M.: Making Use - Scenario-Based Design of Human-Computer Interactions. MIT Press, Cambridge (2000)

    Google Scholar 

  32. Hornecker, E., Eden, H., Scharff, E.: In my situation, i would dislike thaaat!” - role play as assessment method for tools supporting participatory planning. In: Proceedings of PDC 2002: 7th Biennial Participatory Design Conference, Malmö (2002)

    Google Scholar 

  33. Oulasvirta, A., Kurvinen, E., Kankainen, T.: Understanding contexts by being there: case studies in bodystorming. Personal Ubiquitous Comput. 7(2), 125–134 (2003)

    Article  Google Scholar 

  34. Schuler, D., Namioka, A. (eds.): Participatory Design: Principles and Practices. Lawrence Erlbaum Associates, Hillsdale (1993)

    Google Scholar 

  35. Franinovic, K., Gaye, L., Behrendt, F.: Exploring sonic interaction with artifacts in everyday contexts. In: Proceedings of the 14th International Conference on Auditory Display (2008)

    Google Scholar 

  36. Aarts, E., Marzano, S. (eds.): The New Everyday, Rotterdam, The Netherlands. 010 Publishers (2003)

    Google Scholar 

  37. Oleksik, G., Frohlich, D., Brown, L.M., Sellen, A.: Sonic interventions: Understanding and extending the domestic soundscape. In: Proceedings of the 26th Annual CHI Conference on Human Factors in Computing Systems, pp. 1419–1428 (2008)

    Google Scholar 

  38. Visell, Y., Franinovic, K., Hug, D.: Sound product design research: Case studies, participatory design, scenarios, and product concepts. nest-closed deliverable 3.1 (June 2007)

    Google Scholar 

  39. Böhme, G.: Acoustic atmospheres - a contribution to the study of ecological aesthetics. Soundscape - The Journal of Acoustic Ecology 1(1), 14–18 (2000)

    Google Scholar 

  40. Fischer-Lichte, E.: Ästhetische Erfahrung: Das Semiotische und das Performative. A. Francke Verlag, Tübingen und Basel (2001)

    Google Scholar 

  41. Austin, J.L.: How to do Things With Words, 2nd edn. Harvard University Press, Cambridge (1975)

    Google Scholar 

  42. Meyer, P.M.: Intermedialität des Theaters: Entwurf einer Semiotik der Überraschung, Parerga, Düsseldorf (2001)

    Google Scholar 

  43. Pauletto, S., Hug, D., Barras, S., Luckhurst, M.: Integrating theatrical strategies into sonic interaction design. In: Proceedings of Audio Mostly 2009 - 4th Conference on Interaction with Sound (2009)

    Google Scholar 

  44. Fischer-Lichte, E.: Ästhetik des Performativen, Suhrkamp (2004)

    Google Scholar 

  45. Nöth, W.: Handbuch der Semiotik. 2., vollständig neu bearb. und erw. aufl. edn. J. B. Metzler (2000)

    Google Scholar 

  46. Lefebvre, H.: Kritik des Alltagslebens: Grundrisse einer Soziologie der Alltäglichkei. Fischer, Frankfurt am Main (1987)

    Google Scholar 

  47. Gibson, J.J.: The ecological approach to visual perception. Houghton Mifflin, Boston (1979)

    Google Scholar 

  48. Hermann, T., Ritter, H.: Listen to your data: Model-based sonification for data analysis. In: Advances in intelligent computing and multimedia systems, Baden-Baden, pp. 189–194 (1999)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Hug, D. (2010). Investigating Narrative and Performative Sound Design Strategies for Interactive Commodities. In: Ystad, S., Aramaki, M., Kronland-Martinet, R., Jensen, K. (eds) Auditory Display. CMMR ICAD 2009 2009. Lecture Notes in Computer Science, vol 5954. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12439-6_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12439-6_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12438-9

  • Online ISBN: 978-3-642-12439-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics