Skip to main content
SpringerLink
Log in

Assessment of Students’ Cognitive Conditions in Medical Simulation Training: A Review Study

  • Conference paper
  • First Online:
Advances in Human Factors and Simulation (AHFE 2019)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 958))

Included in the following conference series:

Abstract

Although performance measures are strongly used in the field of medical education to evaluate skills of trainees and medical students, the assessment of their cognitive state is relatively “uncommon”. This fact is disadvantageous if we consider the introduction of technologies as physical medical simulators and augmented/virtual reality devices, which may represent an improvement in the students’ immersion in the simulated scenario or, conversely, a potential risk of a serious information overload. Therefore, a precise assessment of the cognitive conditions is an essential element of the design process of a medical training session. This study aims to provide the current state in literature on the assessment of cognitive state during medical simulation training sessions. It provides critical insights on the validity and reliability of current metrics and helps in the selection of measurements tools when applied in simulation-based training contexts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Studer, R.K., Danuser, B., Gomez, P.: Physicians’ psychophysiological stress reaction in medical communication of bad news: a critical literature review. Int. J. Psychophysiol. 120, 14–22 (2017)

    Article  Google Scholar 

  2. Parasuraman, R.: Neuroergonomics: brain, cognition, and performance at work. Curr. Dir. Psychol. Sci. 20, 181–186 (2011)

    Article  Google Scholar 

  3. Parasuraman, R., Sheridan, T.B., Wickens, C.D.: Situation awareness, mental workload, and trust in automation: viable, empirically supported cognitive engineering constructs. J. Cogn. Eng. Decis. Mak. 2, 140–160 (2008)

    Article  Google Scholar 

  4. Dias, R.D., Ngo-Howard, M.C., Boskovski, M.T., Zenati, M.A., Yule, S.J.: Systematic review of measurement tools to assess surgeons’ intraoperative cognitive workload. Glob. Surg. 105(5), 491–501 (2018)

    Google Scholar 

  5. Fraser, K., Ma, I., Teteris, E., Baxter, H., Wright, B., McLaughlin, K.: Emotion, cognitive load and learning outcomes during simulation training. Med. Educ. 46(11), 1055–1062 (2012)

    Article  Google Scholar 

  6. Van Merriënboer, J.J.G., Sweller, J.: Cognitive load theory in health professional education: design principles and strategies. Med. Educ. 44(1), 85–93 (2010)

    Article  Google Scholar 

  7. Charles, R.L., Nixon, J.: Measuring mental workload using physiological measures: a systematic review. Appl. Ergon. 74, 221–232 (2019)

    Article  Google Scholar 

  8. Atalay, K.D., Can, G.F., Erdem, S.R., Müderrisoglu, I.H.: Assessment of mental workload and academic motivation in medical students. J. Pak. Med. Assoc. 66, 574 (2016)

    Google Scholar 

  9. Du, W., Kim, J.H.: Performance-based eye-tracking analysis in a dynamic monitoring task. In: International Conference on Augmented Cognition, pp. 168–177 (2016)

    Google Scholar 

  10. Arora, S., Sevdalis, N., Nestel, D., Woloshynowych, M., Darzi, A., Kneebone, R.: The impact of stress on surgical performance: a systematic review of the literature. Surgery 147, 318–330 (2009)

    Article  Google Scholar 

  11. Bosse, H.M., Mohr, J., Buss, B., Krautter, M., Weyrich, P., Herzog, W., Junger, J., Nikendei, C.: The benefit of repetitive skills training and frequency of expert feedback in the early acquisition of procedural skills. BMC Med. Educ. 15, 22 (2015)

    Article  Google Scholar 

  12. Longo, L.: Mental workload in medicine: foundations, applications, open problems, challenges and future perspectives. In: 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS), Belfast and Dublin, Ireland, pp. 106–111 (2016)

    Google Scholar 

  13. Cain, B.: A Review of the Mental Workload Literature. Defense technical information center, Toronto, Canada (2007)

    Google Scholar 

  14. Longo, L.: Formalising human mental workload as a defeasible computational concept (2014)

    Google Scholar 

  15. Wickens, C.D., Gordon, S.E., Liu, Y.: An introduction to human factors engineering, pp. 64–90, Upper Saddle River (2004)

    Google Scholar 

  16. Carswell, C.M., Clarke, D., Seales, W.B.: Assessing mental workload during laparoscopic surgery. Surg. Innov. 12, 80–90 (2005)

    Article  Google Scholar 

  17. Hart, S.G.: Nasa-task load index (NASA-TLX); 20 years later. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, vol. 50, no. 9, pp. 904–908 (2006)

    Article  Google Scholar 

  18. Xie, B., Salvendy, G.: Review and reappraisal of modelling and predicting mental workload in single- and multi-task environments. Work Stress 14(1), 74–99 (2000)

    Article  Google Scholar 

  19. Woods, B., Byrne, A., Bodger, O.: The effect of multitasking on the communication skill and clinical skills of medical students. BMC Med. Educ. 18, 76 (2018)

    Article  Google Scholar 

  20. International Encyclopaedia of Ergonomics and Human Factors. https://www.taylorfrancis.com/books/e/9780849375477

  21. Lee, G.I., Lee, M.R.: Can a virtual reality surgical simulation training provide a self-driven and mentor-free skills learning? Investigation of the practical influence of the performance metrics from the virtual reality robotic surgery simulator on the skill learning and associated cognitive workloads. Surg. Endosc. 32(1), 62–72 (2017)

    Article  Google Scholar 

  22. Boet, S., Sharma, B., Pigford, A., Hladkowicz, E., Rittenhouse, N., Grantcharov, T.: Debriefing decreases mental workload in surgical crisis: a randomized controlled trial. Surgery 161(5), 1215–1220 (2017)

    Article  Google Scholar 

  23. Scerbo, M.W., Britt, R.C., Montano, M., Kennedy, R.A., Prytz, E., Stefanidis, D.: Effects of a retention interval and refresher session on intracorporeal suturing and knot tying skill and mental workload. Surgery 161(5), 1209–1214 (2016)

    Article  Google Scholar 

  24. Gardner, A.K., Clanton, J., Jabbour, I.I., Scott, L., Scott, D.J., Russo, M.A.: Impact of seductive details on the acquisition and transfer of laparoscopic suturing skills: emotionally interesting or cognitively taxing? Surgery 160(3), 580–585 (2016)

    Article  Google Scholar 

  25. Britt, R.C., Scerbo, M.W., Montano, M., Kennedy, R.A., Prytz, E., Stefanidis, D.: Intracorporeal suturing: transfer from fundamentals of laparoscopic surgery to cadavers results in substantial increase in mental workload. Surgery 158(5), 1428–1433 (2015)

    Article  Google Scholar 

  26. Colligan, L., Potts, H.W.W., Finn, C.T., Sinkin, R.A.: Cognitive workload changes for nurses transitioning from a legacy system with paper documentation to a commercial electronic health record. Int. J. Med. Inform. 84(7), 469–476 (2015)

    Article  Google Scholar 

  27. Muresan, C., Lee, T.H., Seagu, J., Park, A.E.: Transfer of training in the development of intracorporeal suturing skill in medical student novices: a prospective randomized trial. In: 11th World Congress of Endoscopic Surgery, Japan, pp. 537–541 (2008)

    Google Scholar 

  28. Wilson, M.R., Poolton, J.M., Malhotra, N., Ngo, K., Bright, E., Masters, R.S.W.: Development and validation of a surgical workload measure: the surgery task load index (SURG-TLX). World J. Surg. 35(9), 1961–1969 (2011)

    Article  Google Scholar 

  29. Wucherer, P., Stefan, P., Abhari, K., Fallavollita, P., Weigl, M., Lazarovici, M., Winkler, A., Weidert, S., Peters, T., De Ribaupierre, S., Eagleson, R., Navab, N.: Vertebroplasty performance on simulator for 19 surgeons using hierarchical task analysis. IEEE Trans. Med. Imaging 34(8), 1730–1737 (2015)

    Article  Google Scholar 

  30. Boles, D.B., Bursk, J.H., Phillips, J.B., Perdelwitz, J.R.: Predicting dual-task performance with the multiple resources questionnaire (MRQ). Hum. Factors: J. Hum. Factors Ergon. Soc. 49, 32–45 (2007)

    Article  Google Scholar 

  31. Carswell, C.M., Lio, C.H., Grant, R., Klein, M.I., Clarke, D., Seales, W.B., Strup, S.: Hands-free administration of subjective workload scales: acceptability in a surgical training environment. Appl. Ergon. 42(1), 138–145 (2010)

    Article  Google Scholar 

  32. Helton, W.S.: Validation of a short stress state questionnaire. Hum. Factors: J. Hum. Factors Ergon. Soc. 48(11), 1238–1242 (2004)

    Google Scholar 

  33. Williams, N.: The borg rating of perceived exertion (RPE) scale. Occup. Med. 67(5), 404–405 (2017)

    Article  Google Scholar 

  34. Haji, F.A., Cheung, J.J.H., Woods, N., Regehr, G., De Ribaupierre, S., Dubrowski, A.: Thrive or overload? The effect of task complexity on novices’ simulation-based learning. Med. Educ. 50(9), 955–968 (2016)

    Article  Google Scholar 

  35. Sørensen, S.M.D., Mahmood, O., Konge, L., Thinggaard, E., Bjerrum, F.: Laser visual guidance versus two-dimensional vision in laparoscopy: a randomized trial. Surg. Endosc. 31(1), 112–118 (2017)

    Article  Google Scholar 

  36. Blanco, M., Biever, W.J., Gallagher, J.P., Dingus, T.A.: The impact of secondary task cognitive processing demand on driving performance. Accid. Anal. Prev. 38(5), 895–906 (2006)

    Article  Google Scholar 

  37. Haji, F.A., Khan, R., Regehr, G., Drake, J., De Ribaupierre, S., Dubrowski, A.: Measuring cognitive load during simulation-based psychomotor skills training: sensitivity of secondary-task performance and subjective ratings. Adv. Health Sci. Educ. 20(5), 1237–1253 (2015)

    Article  Google Scholar 

  38. Hu, J.S.L., Lu, J., Tan, W.B., Lomanto, D.: Training improves laparoscopic tasks performance and decreases operator workload. Surg. Endosc. 30(5), 1742–1746 (2016)

    Article  Google Scholar 

  39. Di Stasi, L.L., Díaz-Piedra, C., Ruiz-Rabelo, J.F., Rieiro, H., Sanchez Carrion, J.M., Catena, A.: Quantifying the cognitive cost of laparo-endoscopic single-site surgeries: gaze-based indices. Appl. Ergon. 65, 168–174 (2017)

    Article  Google Scholar 

  40. Theodoraki, M.N., Ledderose, G.J., Becker, S., Leunig, A., Arpe, S., Luz, M., Stelter, K.: Mental distress and effort to engage an image-guided navigation system in the surgical training of endoscopic sinus surgery: a prospective, randomised clinical trial. Eur. Arch. Otorhinolaryngol. 272(4), 905–913 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Università Politecnica delle Marche, Via Brecce Bianche 12, 60131, Ancona, Italy

    Martina Scafà, Eleonora Brandoni Serrani, Alessandra Papetti, Agnese Brunzini & Michele Germani

Authors
  1. Martina Scafà
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Eleonora Brandoni Serrani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alessandra Papetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Agnese Brunzini
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Michele Germani
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Martina Scafà .

Editor information

Editors and Affiliations

  1. RDRL-HRF-D, U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Daniel N. Cassenti

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Scafà, M., Serrani, E.B., Papetti, A., Brunzini, A., Germani, M. (2020). Assessment of Students’ Cognitive Conditions in Medical Simulation Training: A Review Study. In: Cassenti, D. (eds) Advances in Human Factors and Simulation. AHFE 2019. Advances in Intelligent Systems and Computing, vol 958. Springer, Cham. https://doi.org/10.1007/978-3-030-20148-7_21

Download citation

Publish with us

Policies and ethics

Search

Navigation