Skip to main content

Adaptive Classification for Brain-Machine Interface with Reinforcement Learning

  • Conference paper
Neural Information Processing (ICONIP 2011)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 7062))

Included in the following conference series:

Abstract

Brain machine interface (BMI) is an interface that uses brain activity to interact with computer-based devices. We introduce a BMI system using electroencephalography (EEG) and the reinforcement learning method, in which event-related potential (ERP) represents a reward reflecting failure or success of BMI operations. In experiments, the P300 speller task was conducted with adding the evaluation process where subjects counted the number of times the speller estimated a wrong character. Results showed that ERPs were evoked in the subjects observing wrong output. Those were estimated by using a support vector machine (SVM) which classified data into two categories. The overall accuracy of classification was approximately 58%. Also, a simulation using the reinforcement learning method was conducted. The result indicated that discriminant accuracy of SVM may improve with the learning process in a way that optimizes the constituent parameters.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M.: Brain computer interfaces for communication and control. Clin. Neurophysiol. 113(6), 767–791 (2002)

    Article  Google Scholar 

  2. Barto, A.G., Sutton, R.S., Anderson, C.W.: Neuronlike adaptive elements that can solve difficult learning control problems. IEEE Trans. Syst. Man Cyber. 13(5), 834–846 (1983)

    Article  Google Scholar 

  3. Yamagishi, Y., Tsubone, T., Wada, Y.: Applicability to Reinforcement Signal of Event-Related Potential. In: Proceedings of 22nd SICE Symposium on Biological and Physiological Engineering, pp. 343–346 (2008)

    Google Scholar 

  4. Farwell, L.A., Donchin, E.: Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroenceph. Clin. Neurophysiol. 70, 510–523 (1988)

    Article  Google Scholar 

  5. Takano, K., Komatsu, T., Hata, N., Nakajima, Y., Kansaku, K.: Visual stimuli for the P300 brain.computer interface: A comparison of white/gray and green/blue flicker matrices. Clin. Neurophysiol. 120(8), 1562–1566 (2009)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Matsuzaki, S., Shiina, Y., Wada, Y. (2011). Adaptive Classification for Brain-Machine Interface with Reinforcement Learning. In: Lu, BL., Zhang, L., Kwok, J. (eds) Neural Information Processing. ICONIP 2011. Lecture Notes in Computer Science, vol 7062. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24955-6_44

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-24955-6_44

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-24954-9

  • Online ISBN: 978-3-642-24955-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics