Abstract
Different design approaches contributed to what we see today as the prevalent design paradigm for Human Computer Interaction; though they have been mostly applied to the visual aspect of interaction. In this paper we presented a proposal for sound design strategies that can be used in applications involving affective interaction. For testing our approach we propose the sonification of the Affective Diary, a digital diary with focus on emotions, affects, and bodily experience of the user. We applied results from studies in music and emotion to sonic interaction design. This is one of the first attempts introducing different physics-based models for the real-time complete sonification of an interactive user interface in portable devices.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Schafer, R.M.: The Soundscape. Our Sonic Environment and The Tuning of the World. Destiny Books, Rochester, Vermont (1994)
Gaver, W.W.: What in the world do we hear? an ecological approach to auditory event perception. Ecological Psychology 5(1), 1–29 (1993)
Giordano, B., Bresin, R.: Walking and playing: What’s the origin of emotional expressiveness in music? In: Baroni, M., Addessi, A.R., Caterina, R., Costa, M. (eds.) ICMPC9 - 9th International Conference on Music Perception & Cognition, Bologna, p. 149. Bonomia University Press (abstract) (August 2006)
VVAA: A Roadmap for Sound and Music Computing. The S2S2 Consortium (2007), http://www.soundandmusiccomputing.org/roadmap
Gibson, J.J.: The Ecological Approach to Visual Perception. Lawrence Erlbaum, Mahwah
Rocchesso, D., Bresin, R., Fernstrm, M.: Sounding object. IEEE Multimedia Magazine 10(2), 42–52 (2003)
Dourish, P.: Where the Action Is: The Foundations of Embodied Interaction. The MIT Press, Cambridge (2001)
Krumhansl, C.: An exploratory study of musical emotions and psychophysiology. Can J. Exp. Psychol. 51(4), 336–353 (1997)
Schröder, M.: Emotional speech synthesis: A review. In: Eurospeech, vol. 1, pp. 561–564 (2001)
Juslin, P.N., Laukka, P.: Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin 129(5), 770–814 (2003)
Bresin, R., Friberg, A.: Emotional coloring of computer-controlled music performances. Computer Music Journal 24(4), 44–63 (2000)
Lindström, A., Ståhl, A., Höök, K., Sundström, P., Laaksolathi, J., Combetto, M., Taylor, A., Bresin, R.: Affective diary: designing for bodily expressiveness and self-reflection. In: CHI 2006. extended abstracts on Human factors in computing systems, pp. 1037–1042. ACM Press, New York (2006)
Ishii, H., Ullmer, B.: Tangible bits: towards seamless interfaces between people, bits and atoms. In: CHI 1997. Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 234–241. ACM Press, New York (1997)
Rocchesso, D., Ottaviani, L., Fontana, F.: Size, shape, and material properties of sound models. In: Rocchesso, D., Fontana, F. (eds.) The Sounding Object, Mondo Estremo, Florence, Italy, pp. 95–110 (2003)
Rath, M., Fontana, F.: High-level models: bouncing, breaking, rolling, crumpling, pouring. In: Rocchesso, D., Fontana, F. (eds.) The Sounding Object, Mondo Estremo, Florence, Italy, pp. 173–204 (2003)
Luis, I.F., Bresin, R.: Influence of expressive music on the perception of short text messages. In: Baroni, M., Addessi, A.R., Caterina, R., Costa, M. (eds.) ICMPC9 – 9th International Conference on Music Perception & Cognition, 244 abstract only (2006)
Fontana, F., Bresin, R.: Physics-based sound synthesis and control: crushing, walking and running by crumpling sounds. In: XIV Colloquium on Musical Informatics, XIV CIM 2003, Florence, Italy, pp. 109–114 (2003)
Avanzini, F., Serafin, S., Rocchesso, D.: Interactive simulation of rigid body interaction with friction-induced sound generation. IEEE Transactions on Speech and Audio Processing 13(5), 1073–1081 (2005)
Friberg, A.: pDM: an expressive sequencer with real-time control of the KTH music performance rules movements. Computer Music Journal 30(1), 37–48 (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
DeWitt, A., Bresin, R. (2007). Sound Design for Affective Interaction. In: Paiva, A.C.R., Prada, R., Picard, R.W. (eds) Affective Computing and Intelligent Interaction. ACII 2007. Lecture Notes in Computer Science, vol 4738. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74889-2_46
Download citation
DOI: https://doi.org/10.1007/978-3-540-74889-2_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74888-5
Online ISBN: 978-3-540-74889-2
eBook Packages: Computer ScienceComputer Science (R0)