Skip to main content

Real-Time Monitoring of ECG and GSR Signals during Computer-Based Training

  • Conference paper
Intelligent Tutoring Systems (ITS 2012)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 7315))

Included in the following conference series:

Abstract

The potential of Intelligent Tutoring Systems (ITSs) to influence learning may be greatly enhanced by the tutor’s ability to accurately assess the student’s state in real-time and then use this state as a basis to provide timely feedback or alter the instructional content. In order to maximize the ITS’ potential to influence learning, the physiological state of students needs to be captured and assessed. Electrocardiogram (ECG) and Galvanic Skin Response (GSR) data has been shown to be correlated to physiological state data, but the development of real-time processing and analysis of this data in an educational context has been limited. This article describes an experiment where nineteen participants interacted with the Cultural Meeting Trainer (CMT), a web-based cultural negotiation trainer. Metrics of mean, standard deviation, and signal energy were collected from the GSR datastream while instantaneous and average heart rate were collected from the ECG datastream using a windowing technique around important interactions. Our analysis assesses these measures across three interaction scenarios. The findings of this experiment influence the appropriateness of instructional intervention, and drive the development of real-time assessment for education.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Verdú, E., Regueras, L.M., Verdú, M.J., De Castro, J.P., Pérez, M.A.: Is Adaptive Learning Effective? A Review of the Research. In: Proceedings of the 7th WSEAS International Conference on Applied Computer & Applied Computational Science (ACACOS 2008), pp. 710–715. WSEAS Press, Stevens Point (2008)

    Google Scholar 

  2. Woolf, B.: Reasoning about Teaching and Learning. In: 10th Conference of Spanish Association for Artificial Intelligence (CAEPIA 2003) and the 5th Conference on Technology Transfer (TTIA 2003), San Sebastian, Spain (November 2003)

    Google Scholar 

  3. Bloom, B.S.: The 2 sigma problem. The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher 13(6), 4–16 (1984)

    Google Scholar 

  4. Lehman, B., Matthews, M., D’Mello, S., Person, N.: What Are You Feeling? Investigating Student Affective States During Expert Human Tutoring Sessions. In: Woolf, B.P., Aïmeur, E., Nkambou, R., Lajoie, S. (eds.) ITS 2008. LNCS, vol. 5091, pp. 50–59. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  5. Isen, A.M.: Positive Affect and Decision Making. In: Lewis, M., Haviland, J.M. (eds.) Handbook of Emotions, pp. 261–277. Guilford Press, New York (1993)

    Google Scholar 

  6. Woolf, B., Burleson, W., Arroyo, I., Dragon, T., Cooper, D., Picard, R.: Affect-Aware Tutors: Recognizing and Responding to Student Affect. International Journal of Learning Technology 4, 129–164 (2009)

    Article  Google Scholar 

  7. D’Mello, S.K., Craig, S.D., Gholson, B., Franklin, S., Picard, R.W., Graesser, A.C.: Integrating Affect Sensors in an Intelligent Tutoring System. In: Affective Interactions: The Computer in the Affective Loop Workshop at 2005 International Conference on Intelligent User Interfaces, pp. 7–13. AMC Press, New York (2005)

    Google Scholar 

  8. Handri, S., Yajima, K., Nomura, S., Ogawa, N., Kurosawa, Y., Fukumura, Y.: Evaluation of Student’s Physiological Response Towards E-Learning Courses Material by Using GSR Sensor. In: 2010 IEEE/ACIS 9th International Conference on Computer and Information Science (ICIS), pp. 805–810. IEEE, Los Alamitos (2010)

    Chapter  Google Scholar 

  9. Goldberg, B.S., Sottilare, R.A., Brawner, K.W., Holden, H.K.: Predicting Learner Engagement during Well-Defined and Ill-Defined Computer-Based Intercultural Interactions. In: D’Mello, S., Graesser, A., Schuller, B., Martin, J.-C. (eds.) ACII 2011, Part I. LNCS, vol. 6974, pp. 538–547. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  10. Sottilare, R., Holden, H., Brawner, K., Goldberg, B.: Challenges and Emerging Concepts in the Development of Adaptive, Computer-based Tutoring Systems for Team Training. In: I/ITSEC Emerging Concepts Group Proceedings, Orlando, Florida (2011)

    Google Scholar 

  11. Pan, J., Tompkins, W.J.: A real-time QRS detection algorithm. IEEE Trans. Biomed. Eng. BME 32(3), 230–236 (1985)

    Article  Google Scholar 

  12. Grundlehner, B., Brown, L., Penders, J., Gyselinckx, B.: The design and analysis of real-time, continuous arousal monitor. In: Proceedings of the 6th International Workshop on Wearable and Implantable Body Sensor Networks (2009)

    Google Scholar 

  13. Lessiter, J., Freeman, J., Keogh, E., Davidoff, J.: A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory. Presence 10(3), 282–297 (2001)

    Article  Google Scholar 

  14. Bradley, M.M., Lang, P.J.: Measuring emotion: The Self-Assessment Manikin and the Semantic Differential. Journal of Behavior Therapy and Experimental Psychiatry 25(1), 49–59 (1994)

    Article  Google Scholar 

  15. Kapoor, A., Burleson, W., Picard, R.W.: Automatic prediction of frustration. International Journal of Human-Computer Studies 65, 724–736 (2007)

    Article  Google Scholar 

  16. Hockey, G.R.J.: A state control theory of adaptation to stress and individual differences in stress management. In: Hockey, G.R.J., Gaillard, A.W.K., Coles, M.G.H. (eds.) Energetics and Human Information Processing. Martinus Nijhoff, Dordrect (1986)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Brawner, K.W., Goldberg, B.S. (2012). Real-Time Monitoring of ECG and GSR Signals during Computer-Based Training. In: Cerri, S.A., Clancey, W.J., Papadourakis, G., Panourgia, K. (eds) Intelligent Tutoring Systems. ITS 2012. Lecture Notes in Computer Science, vol 7315. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30950-2_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-30950-2_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-30949-6

  • Online ISBN: 978-3-642-30950-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics