Abstract
This paper presents the development of methods for gesture control of sound spatialization. It provides a comparison of seven popular software spatialization systems from a control point of view, and examines human-factors issues relevant to gesture control. An effort is made to reconcile these two design- and parameter-spaces, and draw useful conclusions regarding likely successful mapping strategies. Lastly, examples are given using several different gesture-tracking and motion capture systems controlling various parameters of the spatialization system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Zvonar, R.: A history of spatial music (2006), http://cec.concordia.ca/econtact/Multichannel/spatial_music.html
Chadabe, J.: Electric Sound: The Past and Promise of Electronic Music. Prentice-Hall, Englewood Cliffs (1997)
Ramakrishnan, C., Goßmann, J., Brm̈mer, L.: The zkm klangdom. In: Proceedings of the 2006 Conference on New Interfaces for Musical Expression (2006)
Valbom, L., Marcos, A.: Wave: Sound and music in an immersive environment. Computers and Graphics 29, 871–881 (2005)
Naef, M., Collicott, D.: A vr interface for collaborative 3d audio performance. In: Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME 2006), pp. 57–60 (2006)
Wozniewski, M., Settel, Z., Cooperstock, J.: A system for immersive spatial audio performance. In: Proceedings of the 2006 Conference on New Interfaces for Musical Expression (2006)
Schacher, J.: Gesture control of sounds in 3d space. In: Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME 2007), New York, USA, pp. 358–362 (2007)
Pulkki, V.: Spatial Sound Generation and Perception by Amplitude Panning Techniques. PhD thesis, Helsinki University of Technology (2001)
IRCAM: Spatializateur website, http://forumnet.ircam.fr/356.html
Braasch, J.: A loudspeaker based sound projection using virtual microphone control (vimic). In: 118th Convention of the AES, Barcelona, Spain (2005)
Spors, S., Teutsch, H., Rabenstein, R.: High-quality acoustic rendering with wave field synthesis. Vision, Modeling, and Visualization, 101–108 (2002)
Malham, D.: Spatial hearing mechanisms and sound reproduction. Technical report, Music Technology Group, University of York (1998)
Jacob, R.J.K., Sibert, L.E., McFarlane, D.C., Mullen, M.P.: Integrality and separability of input devices. ACM Transactions on Computer-Human Interaction 1(1), 3–26 (1994)
Cooper, G.: Research into cognitive load theory and instructional design at unsw (December 1998), http://education.arts.unsw.edu.au/staff/sweller/clt/index.html
Cook, P.: Principles for designing computer music controllers. In: ACM CHI 2001 Workshop on New Interfaces for Musical Expression (2001)
Marshall, M.T., Peters, N., Jensenius, A.R., Boissinot, J., Wanderley, M.M., Braasch, J.: On the development of a system for the gesture control of spatialization. In: Proceedings of the International Computer Music Conference, pp. 260–266 (2006)
Baecker, R., Grudin, J., Buxton, W., Greenberg, S.: Readings in Human-Computer Interaction: Toward the Year 2000., 2nd edn. Morgan Kaufmann, San Francisco (1995)
Cadoz, C., Wanderley, M.: Gesture - music. Trends in Gesture Control of Music (2000)
Marshall, M., Malloch, J., Wanderley, M.: Using the ’energy’ of performance gestures as a control for a spatialization system. Technical Report MUMT-IDMIL-07-08, Input Devices and Music Interaction Laboratory, McGill University (May 2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Marshall, M.T., Malloch, J., Wanderley, M.M. (2009). Gesture Control of Sound Spatialization for Live Musical Performance. In: Sales Dias, M., Gibet, S., Wanderley, M.M., Bastos, R. (eds) Gesture-Based Human-Computer Interaction and Simulation. GW 2007. Lecture Notes in Computer Science(), vol 5085. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92865-2_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-92865-2_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-92864-5
Online ISBN: 978-3-540-92865-2
eBook Packages: Computer ScienceComputer Science (R0)