Skip to main content
SpringerLink
Log in

A Customizable Recognizer for Orchestral Conducting Gestures Based on Neural Networks

  • Conference paper
Applications of Evolutionary Computation (EvoApplications 2011)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 6625))

Included in the following conference series:

Abstract

In this paper we present a system for the recognition of orchestral conducting gestures using the Nintendo Wiimote controller. The system is based on a neural network. This is not the first of such systems; however compared to previous systems that use the Wiimote or other cheap hardware, it has several advantages: it is fully customizable, continuous and does not require third party commercial software.

The system has been implemented in Java and we have run several tests to evaluate its behavior.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bradshaw, D., Ng, K.: Tracking conductors hand movements using multiple wiimotes. In: Proceedings of the International Conference on Automated Solutions for Cross Media Content and Multi-channel Distribution (AXMEDIS 2008), Firenze, Italy, pp. 93–99. IEEE Computer Society Press, Los Alamitos (2008)

    Chapter  Google Scholar 

  2. Lee, J.C.: Hacking the Nintendo Wii remote. Pervasive Computing 7(3), 39–45 (2008)

    Article  Google Scholar 

  3. Kiefer, C., Collins, N., Fitzpatrick, G.: Evaluating the Wiimote as a musical controller. In: Proceedings of the International Computer Music Conference, Belfast, N. Ireland (2008)

    Google Scholar 

  4. Ilmonen, T., Takala, T.: Conductor following with artificial neural networks. In: Proceedings of the International Computer Music Conference, Bejing, China (1999)

    Google Scholar 

  5. Hofmann, F.G., Heyer, P., Hommel, G.: Velocity profile based recognition of dynamic gestures with discrete Hidden Markov Models. In: Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction, pp. 81–95. Springer, London (1998)

    Chapter  Google Scholar 

  6. Kolesnik, P., Wanderley, M.: Recognition, analysis and performance with expressive conducting gesture. In: Proceedings of the International Computer Music Conference, Miami, USA (2004)

    Google Scholar 

  7. Liang, H., Ouhyoung, M.: A real-time continuous gesture recognition system for sign language. In: Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, p. 558 (1998)

    Google Scholar 

  8. Mathews, M.: The radio baton and the conductor program, or: Pitch-the most important and least expressive part of music. Computer Music Journal 15(4), 37–46 (1991)

    Article  Google Scholar 

  9. Miranda, E.R., Wanderley, M.: New digital musical instruments: Control and interaction beyond the keyboard. A-R Editions, Middleton (2006)

    Google Scholar 

  10. Mlich, J.: Wiimote gesture recognition. In: Proceedings of the 15th Conference and Competition STUDENT EEICT 2009, vol. 4, pp. 344–349 (2009)

    Google Scholar 

  11. Bruegge, B., Teschner, C., Lachenmaier, P., Fenzl, E., Schmidt, D., Bierbaum, S.: Pinocchio: Conducting a virtual symphony orchestra. In: Proceedings of the International Conference on Advances in Computer Entertainment Technology (ACE), Salzburg, Austria, pp. 294–295 (2007)

    Google Scholar 

  12. Schlömer, T., Poppinga, B., Henze, N., Boll, S.: Gesture recognition with a Wii controller. In: Proceedings of the 2nd International ACM Conference on Tangible and Embedded Interaction, New York, NY, USA, pp. 11–14 (2008)

    Google Scholar 

  13. Nakra, T.M., Ivanov, Y., Smaragdis, P., Ault, C.: The UBS virtual maestro: An interactive conducting system. In: Proceeding of 9th International Conference on New Interfaces for Musical Expression, Pittsburgh, PA, USA (2009)

    Google Scholar 

  14. Wii yourself website, http://wiiyourself.gl.tter.org/

Download references

Author information

Authors and Affiliations

  1. Laboratorio di Musimatica Dipartimento di Informatica, Università di Salerno, 84084, Fisciano, SA, Italy

    Roberto De Prisco, Paolo Sabatino, Gianluca Zaccagnino & Rocco Zaccagnino

Authors
  1. Roberto De Prisco
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paolo Sabatino
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Gianluca Zaccagnino
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Rocco Zaccagnino
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Mathematics and Statistics, University of Strathclyde, 16 Richmond Street, G1 1XQ, Glasgow, UK

    Cecilia Di Chio

  2. School of Business, University College Dublin, 4, Belfield, Dublin, UK

    Anthony Brabazon

  3. Istituto Dalle Molle di Studi sull’Intelligenza Artificiale (IDSIA), Galleria 2, 6928, Manno-Lugano, Switzerland

    Gianni A. Di Caro

  4. Institute of Computer Science, University of Bremen, 28359, Bremen, Germany

    Rolf Drechsler

  5. Next Generation Intelligent Networks Research Center (nexGIN RC), National University of Computer & Emerging Sciences (FAST-NU), Islamabad, Pakistan

    Muddassar Farooq

  6. Department of Information Systems, Johannes Gutenberg-Universität, 55099, Mainz, Germany

    Jörn Grahl

  7. Mathematics and Computer Science Depatment, University of Richmond, 23173, Richmond, VA, USA

    Gary Greenfield

  8. ICD - OSI, University of Technology of Troyes, 12, Rue Marie Curie, BP 2060, 10010, Troyes, France

    Christian Prins

  9. Facultad de Informatica, Universidade de A Coruña, 15071, Coruña, CP, Spain

    Juan Romero

  10. Dipartimento di Automatica e Informatica, Politecnico di Torino, Italy

    Giovanni Squillero

  11. Consiglio Nazionale delle Ricerche (CNR), Istituto di Calcolo e Reti ad Alte Prestazioni (ICAR), Via P. Castellino 111, 80131, Naples, Italy

    Ernesto Tarantino

  12. Dipartimento di Tecnologie dell’Informazione, Università degli Studi di Milano, Via Bramante 65, 26013, Crema (CR), Italy

    Andrea G. B. Tettamanzi

  13. School of Computing, Edinburgh Napier University, 10 Clinton Road, EH10 5DT, Edinburgh, UK

    Neil Urquhart

  14. Computer Engineering Department, Istanbul Technical University, Room Nr. 3302, Maslak, 34469, Istanbul, Turkey

    A. Şima Uyar

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

De Prisco, R., Sabatino, P., Zaccagnino, G., Zaccagnino, R. (2011). A Customizable Recognizer for Orchestral Conducting Gestures Based on Neural Networks. In: Di Chio, C., et al. Applications of Evolutionary Computation. EvoApplications 2011. Lecture Notes in Computer Science, vol 6625. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20520-0_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-20520-0_26

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-20519-4

  • Online ISBN: 978-3-642-20520-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation