Skip to main content

Touchless Virtual Keyboard Controlled by Eye Blinking and EEG Signals

  • Conference paper
  • First Online:
Man-Machine Interactions 5 (ICMMI 2017)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 659))

Included in the following conference series:

Abstract

The paper describes the idea of touchless virtual keyboard designed for disabled people with tetraparesis. Each key can be selected by three double eye blinks registered by EMG sensor. EEG signals are used as a support that allows the user to change the input mode of single characters to the mode of predicted words selection. The keyboard was implemented and evaluated during provided experiments. Obtained result (\(WPM=1.11\)) partially confirms the calculated typing speed (\(WPM=1.23\)). It is also found that the keyboard efficiency can be improved by using a list of predicted words, even the number of those words is low and they are short (\(WPM=1.27\)). Provided discuss presents that improved keyboard used by experienced users could achieve the typing efficiency even up to \(WPM=3.15\).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. B10NUMB3R5: Average duration of a single eye blink (2008). http://bionumbers.hms.harvard.edu/bionumber.aspx?s=y&id=100706

  2. Cecotti, H.: A self-paced and calibration-less SSVEP-based brain-computer interface speller. IEEE Trans. Neural Syst. Rehabil. Eng. 18(2), 127–133 (2010)

    Article  Google Scholar 

  3. Chapin, J.K., Moxon, K.A., Markowitz, R.S., Nicolelis, M.A.: Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex. Nat. Neurosci. 2(7), 664–670 (1999)

    Article  Google Scholar 

  4. Duchowski, A.T.: Eye Tracking Methodology. Theory and Practice. Springer, London (2007)

    MATH  Google Scholar 

  5. Hwang, H.J., Kim, S., Choi, S., Im, C.H.: EEG-based brain-computer interfaces: a thorough literature survey. Int. J. Hum.-Comput. Interact. 29(12), 814–826 (2013)

    Article  Google Scholar 

  6. Kang, K., Hong, J.: A framework for computer interface using EEG and EMG. In: RACS 2015, Prague, Czech Republic, pp. 472–473 (2015)

    Google Scholar 

  7. Krapic, L., Lenac, K., Ljubic, S.: Integrating Blink Click interaction into a head tracking system: implementation and usability issues. Univ. Access Inf. Soc. 14(2), 247–264 (2015)

    Article  Google Scholar 

  8. Królak, A., Strumiłło, P.: Eye-blink detection system for human-computer interaction. Univ. Access Inf. Soc. 11(4), 409–419 (2012)

    Article  Google Scholar 

  9. Lin, C.T., Chen, Y.C., Huang, T.Y., Chiu, T.T., Ko, L.W., Liang, S.F., Hsieh, H.Y., Hsu, S.H., Duann, J.R.: Development of wireless brain computer interface with embedded multitask scheduling and its application on real-time driver’s drowsiness detection and warning. IEEE Trans. Biomed. Eng. 55(5), 1582–1591 (2008)

    Article  Google Scholar 

  10. Lin, C.T., Lin, F.C., Chen, S.A., Lu, S.W., Chen, T.C., Ko, L.W.: EEG-based brain-computer interface for smart living environmental auto-adjustment. J. Med. Biol. Eng. 30(4), 237–245 (2010)

    Article  Google Scholar 

  11. MacKenzie, I.S., Ashtiani, B.: BlinkWrite: efficient text entry using eye blinks. Univ. Access Inf. Soc. 10(1), 69–80 (2011)

    Article  Google Scholar 

  12. MacKenzie, I.S., Soukoreff, R.W.: Phrase sets for evaluating text entry techniques. In: CHI 2003, Ft. Lauderdale, FL, USA, pp. 754–755 (2003)

    Google Scholar 

  13. Majaranta, P.: Communication and text entry by gaze. In: Majaranta, P. (ed.) Gaze Interaction and Applications of Eye Tracking: Advances in Assistive, pp. 63–77. IGI Global, Hershey (2012)

    Google Scholar 

  14. Marshall, D., Coyle, D., Wilson, S., Callaghan, M.: Games, gameplay, and BCI: the state of the art. IEEE Trans. Comput. Intell. AI Games 5(2), 82–99 (2013)

    Article  Google Scholar 

  15. McFarland, D.J., Krusienski, D.J., Sarnacki, W.A., Wolpaw, J.R.: Emulation of computer mouse control with a noninvasive brain-computer interface. J. Neural Eng. 5(2), 101 (2008)

    Article  Google Scholar 

  16. NeuroSky: Neurosky MindWave Mobile EEG. http://store.neurosky.com/pages/mindwave. Accessed 12 2016

  17. Obermaier, B., Muller, G.R., Pfurtscheller, G.: “Virtual keyboard” controlled by spontaneous EEG activity. IEEE Trans. Neural Syst. Rehabil. Eng. 11(4), 422–426 (2003)

    Article  MATH  Google Scholar 

  18. Păsărică, A., Bozomitu, R.G., Cehan, V., Rotariu, C.: Eye blinking detection to perform selection for an eye tracking system used in assistive technology. In: SIITME 2016, Oradea, Romania, pp. 213–216 (2016)

    Google Scholar 

  19. Perego, P., Turconi, A., Andreoni, G., Gagliardi, C.: Cognitive ability assessment by brain-computer interface II: application of a BCI-based assessment method for cognitive abilities. Brain-Comput. Interfaces 1(3–4), 170–180 (2014)

    Article  Google Scholar 

  20. Scherer, R., Muller, G., Neuper, C., Graimann, B., Pfurtscheller, G.: An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate. IEEE Trans. Biomed. Eng. 51(6), 979–984 (2004)

    Article  Google Scholar 

  21. Soukoreff, R.W., MacKenzie, I.S.: Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic. In: CHI 2001, Seattle, WA, USA, pp. 319–320 (2001)

    Google Scholar 

  22. Stamps, K., Hamam, Y.: Towards inexpensive BCI control for wheelchair navigation in the enabled environment–a hardware survey. In: Brain Informatics. LNCS, vol. 6334, pp. 336–345. Springer, Heidelberg (2010)

    Google Scholar 

  23. Tan, D.S., Nijholt, A.: Brain-Computer Interfaces. Applying our Minds to Human-Computer Interaction. Springer, London (2010)

    Google Scholar 

Download references

Acknowledgements

Publication financed by the Institute of Informatics at Silesian University of Technology, statutory research no. 02/020/BK-16/0077.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Krzysztof Dobosz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Dobosz, K., Stawski, K. (2018). Touchless Virtual Keyboard Controlled by Eye Blinking and EEG Signals. In: Gruca, A., Czachórski, T., Harezlak, K., Kozielski, S., Piotrowska, A. (eds) Man-Machine Interactions 5. ICMMI 2017. Advances in Intelligent Systems and Computing, vol 659. Springer, Cham. https://doi.org/10.1007/978-3-319-67792-7_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-67792-7_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-67791-0

  • Online ISBN: 978-3-319-67792-7

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics