Abstract
This paper presents a virtual embodied agent that can conduct musicians in a live performance. The virtual conductor conducts music specified by a MIDI file and uses input from a microphone to react to the tempo of the musicians. The current implementation of the virtual conductor can interact with musicians, leading and following them while they are playing music. Different time signatures and dynamic markings in music are supported.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Wang, T., Zheng, N., Li, Y., Xu, Y., Shum, H.: Learning kernel-based HMMs for dynamic sequence synthesis. In: Veloso, M., Kambhampati, S. (eds.) Graphical Models, vol. 65, pp. 206–221 (2003)
Ruttkay, Z., Huang, A., Eliëns, A.: The Conductor: Gestures for embodied agents with logic programming. In: Proc. of the 2nd Hungarian Computer Graphics Conference, Budapest, pp. 9–16 (2003)
Borchers, J., Lee, E., Samminger, W., Mühlhäuser, M.: Personal orchestra: a real-time audio/video system for interactive conducting. Multimedia Systems 9, 458–465 (2004)
Marrin Nakra, T.: Inside the Conductor’s Jacket: Analysis, Interpretation and Musical Synthesis of Expressive Gesture. Ph.D. Thesis, Media Laboratory. Cambridge, MA, Mass. Inst. of Technology (2000)
Murphy, D., Andersen, T.H., Jensen, K.: Conducting Audio Files via Computer Vision. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS, vol. 2915, pp. 529–540. Springer, Heidelberg (2004)
Dannenberg, R., Mukaino, H.: New Techniques for Enhanced Quality of Computer Accompaniment. In: Proc. of the International Computer Music Conference, Computer Music Association, pp. 243–249 (1988)
Vercoe, B.: The synthetic performer in the context of live musical performance. In: Proc. of the International Computer Music Association, p. 185 (1984)
Raphael, C.: Musical Accompaniment Systems. Chance Magazine 17(4), 17–22 (2004)
Gouyon, F., Dixon, S.: A Review of Automatic Rhythm Description Systems. Computer music journal 29, 34–54 (2005)
Gouyon, F., Klapuri, A., Dixon, S., Alonso, M., Tzanetakis, G., Uhle, C., Cano, P.: An Experimental Comparison of Audio Tempo Induction Algorithms. IEEE Transactions on Speech and Audio Processing (2006)
Scheirer, E.D.: Tempo and beat analysis of acoustic musical signals. Journal of the Acoustical Society of America 103, 558–601 (1998)
Klapuri, A., Eronen, A., Astola, J.: Analysis of the meter of acoustic musical signals. IEEE transactions on Speech and Audio Processing (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 IFIP International Federation for Information Processing
About this paper
Cite this paper
Bos, P., Reidsma, D., Ruttkay, Z., Nijholt, A. (2006). Interacting with a Virtual Conductor. In: Harper, R., Rauterberg, M., Combetto, M. (eds) Entertainment Computing - ICEC 2006. ICEC 2006. Lecture Notes in Computer Science, vol 4161. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11872320_3
Download citation
DOI: https://doi.org/10.1007/11872320_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-45259-1
Online ISBN: 978-3-540-45261-4
eBook Packages: Computer ScienceComputer Science (R0)