Abstract
In live human-computer music-making, how can interfaces successfully support the openness, reinterpretation and rich signification often important in live (especially improvised) musical performance? We argue that the use of design metaphors can lead to interfaces which constrain interactions and militate against reinterpretation, while consistent, grammatical interfaces empower the user to create and apply their own metaphors in developing their performance. These metaphors can be transitory and disposable, yet do not represent wasted learning since the underlying grammar is retained. We illustrate this move with reflections from live coding practice, from recent visual and two-dimensional programming language interfaces, and from musical voice mapping research. We consider the integration of the symbolic and the continuous in the human-computer interaction. We also describe how our perspective is reflected in approaches to system evaluation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
http://ataut.net/site/Adam-Atau-4-Hands-iPhone.
References
Aaron, S., Blackwell, A. F., Hoadley, R., & Regan, T. (2011). A principled approach to developing new languages for live coding. Proceedings of New Interfaces for Musical Expression, 2011, 381–386.
Blackwell, A. F. (2006a). Psychological issues in end-user programming. In H. Lieberman, F. Paternò, & V. Wulf (Eds.), End user development (Human-computer interaction series 9th ed., pp. 9–30). Dordrecht: Springer. doi:10.1007/1-4020-5386-X_2. chap 2.
Blackwell, A. F. (2006b). The reification of metaphor as a design tool. ACM Transactions on Computer-Human Interaction, 13(4), 490–530. doi:10.1145/1188816.1188820.
Blackwell, A., & Green, T. (2002). Notational systems – the cognitive dimensions of notations framework. In J. M. Carroll (Ed.), HCI models, theories, and frameworks: Toward a multidisciplinary science (pp. 103–134). San Francisco: Morgan Kaufmann.
Carroll, J. M., Mack, R. L., & Kellogg, W. A. (1988). Interface metaphors and user interface design. In M. Helander (Ed.), Handbook of human-computer interaction (pp. 67–85). New York: Elsevier.
Collins, N., McLean, A., Rohrhuber, J., & Ward, A. (2004). Live coding in laptop performance. Organised Sound, 8(03), 321–330. doi:10.1017/S135577180300030X.
Cross, I., & Tolbert, E. (2008). Music and meaning. In The Oxford handbook of music psychology. Oxford: Oxford University Press.
Dromey, C., & Bates, E. (2005). Speech interactions with linguistic, cognitive, and visuomotor tasks. Journal of Speech, Language, and Hearing Research, 48(2), 295–305.
Dubnov, S., McAdams, S., & Reynolds, R. (2006). Structural and affective aspects of music from statistical audio signal analysis: Special topic section on computational analysis of style. Journal of the American Society for Information Science and Technology, 57(11), 1526–1536. doi:10.1002/asi.v57:11.
Henderson, J. (2003). Human gaze control during real-world scene perception. Trends in Cognitive Sciences, 7(11), 498–504. doi:10.1016/j.tics.2003.09.006.
Hendry, D. G., & Green, T. R. G. (1994). Creating, comprehending and explaining spreadsheets: A cognitive interpretation of what discretionary users think of the spreadsheet model. International Journal of Human Computer Studies, 40(6), 1033–1066. doi:10.1006/ijhc.1994.1047.
Jordà , S., Geiger, G., Alonso, M., & Kaltenbrunner, M. (2007). The reacTable: Exploring the synergy between live music performance and tabletop tangible interfaces. In Proceedings of tangible and embedded interaction (pp. 139–146). doi:10.1145/1226969.1226998.
Lakoff, G., & Johnson, M. (1980). Metaphors we live by (2nd ed.). Chicago: University of Chicago Press.
Mandryk, R. L., & Atkins, M. S. (2007). A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. International Journal of Human Computer Studies, 65(4), 329–347. doi:10.1016/j.ijhcs.2006.11.011.
Mcilwain, P., Mccormack, J., Lane, A., & Dorin, A. (2006). Composing with nodal networks. In T. Opie & A. Brown (Eds.), Proceedings of the Australasian Computer Music Conference 2006 (pp. 101–107).
McLean, A., & Wiggins, G. (2011). Texture: Visual notation for the live coding of pattern. In Proceedings of the International Computer Music Conference 2011 (pp. 612–628). Huddersfield.
McLean, A., Griffiths, D., Collins, N., & Wiggins, G. (2010, July 5–7). Visualisation of live code. In Proceedings of Electronic Visualisation and the Arts London 2010 (pp. 26–30). London.
Myers, B. (1990). Taxonomies of visual programming and program visualization. Journal of Visual Languages and Computing, 1(1), 97–123. doi:10.1016/S1045-926X(05)80036-9.
Paivio, A. (1990). Mental representations: A dual coding approach (Oxford psychology series). USA: Oxford University Press, New York.
Patel, A. D. (2007). Music, language, and the brain (1st ed.). USA: Oxford University Press, New York.
Puckette, M. (1988). The patcher. In C. Lischka & J. Fritsch (Eds.), Proceedings of the 1988 International Computer Music Conference, Cologne, September 20–25, 1988 (pp. 420–429).
Runciman, C., & Thimbleby, H. (1986). Equal opportunity interactive systems. International Journal of Man–machine Studies, 25(4), 439–451. doi:10.1016/S0020-7373(86)80070-0.
Stead, A. G. (2011). User configurable machine vision for mobiles. In Proceedings of psychology of programming interest group. York: University of York. http://www.ppig.org/papers/23/15%20Stead.pdf.
Stowell, D. (2010). Making music through real-time voice timbre analysis: machine learning and timbral control. PhD thesis, School of Electronic Engineering and Computer Science, Queen Mary University of London. http://www.mcld.co.uk/thesis/.
Stowell, D., & Plumbley, M. D. (2010). Delayed decision-making in real-time beatbox percussion classification. Journal of New Music Research, 39(3), 203–213. doi:10.1080/09298215.2010.512979.
Stowell, D., & Plumbley, M. D. (2011). Learning timbre analogies from unlabelled data by multivariate tree regression. Journal of New Music Research. doi:10.1080/09298215.2011.596938.
Stowell, D., Robertson, A., Bryan-Kinns, N., & Plumbley, M. D. (2009). Evaluation of live human-computer music-making: Quantitative and qualitative approaches. International Journal of Human Computer Studies, 67(11), 960–975. doi:10.1016/j.ijhcs.2009.05.007.
Wanderley, M. M., & Orio, N. (2002). Evaluation of input devices for musical expression: Borrowing tools from HCI. Computer Music Journal, 26(3), 62–76. doi:10.1162/014892602320582981.
Wilkie, K., Holland, S., & Mulholland, P. (2010). What can the language of musicians tell us about music interaction design? Computer Music Journal, 34(4), 34–48.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag London
About this chapter
Cite this chapter
Stowell, D., McLean, A. (2013). Live Music-Making: A Rich Open Task Requires a Rich Open Interface. In: Holland, S., Wilkie, K., Mulholland, P., Seago, A. (eds) Music and Human-Computer Interaction. Springer Series on Cultural Computing. Springer, London. https://doi.org/10.1007/978-1-4471-2990-5_8
Download citation
DOI: https://doi.org/10.1007/978-1-4471-2990-5_8
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-2989-9
Online ISBN: 978-1-4471-2990-5
eBook Packages: Computer ScienceComputer Science (R0)