Skip to main content

Considerations and Strategies for Assessing: Simulation-Based Training in Interprofessional Education

  • Chapter
  • First Online:
Comprehensive Healthcare Simulation: InterProfessional Team Training and Simulation

Abstract

Interprofessional education (IPE) often relies on simulation-based training to advance the education and performance of a multi-disciplinary team. As such, assessment and evaluation of these simulations must be carefully considered and designed to make best use of valuable time and resources within healthcare. This chapter will discuss the many strategies that may potentially be employed in IPE simulation-based training assessment and other considerations that affect the implementation of assessment.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Swing SR. The ACGME outcome project: retrospective and prospective. Med Teach. 2007;29(7):648–54.

    PubMed  Google Scholar 

  2. Tabish SA. Assessment methods in medical education. Int J Health Sci. 2010;2(2):3–7.

    Google Scholar 

  3. Eva KW, Reiter HI, Rosenfeld J, Norman GR. The ability of the multiple mini-interview to predict pre-clerkship performance in medical school. Acad Med. 2004;79:S40–2.

    PubMed  Google Scholar 

  4. Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system—rationale and benefits. N Engl J Med. 2012 Mar 15;366(11):1051–6.

    CAS  PubMed  Google Scholar 

  5. Frey-Vogel AS, Scott-Vernaglia SE, Carter LP, Huang GC. Simulation for milestone assessment: use of a longitudinal curriculum for pediatric residents. Simul Healthc. 2016;11:286–92.

    PubMed  Google Scholar 

  6. Batmangelich S, Adamowski S. Maintenance of certification in the United States: a progress report. J Contin Educ Health Prof. 2004;24:134–8.

    PubMed  Google Scholar 

  7. Cox M, Irby DM. Assessment in medical education. N Engl J Med. 2007;356:387–96.

    Google Scholar 

  8. Rosen MA, Weaver SJ, Lazzara EH, Salas E, Wu T, Silvestri S, et al. Tools for evaluating team performance in simulation –based training. J Emerg Trauma Shock. 2010;3(4):353–9.

    Google Scholar 

  9. Salas E, Rosen MA, Held JD, Weissmuller JJ. Performance measurement in simulation-based training. Simul Gaming. 2009 June;40(3):328–76.

    Google Scholar 

  10. Reinert A. Assessment in medical education: a primer on methodology. News-Columbia University: College of Physicians and Surgeons. [Internet]. 2013 Sep 09. [cited 2017 Apr 10]. Available from: http://www.ps.columbia.edu/education/sites/default/files/student_life/Assessment%20in%20Medical%20Education%20-%20A%20Primer%20on%20Methodology%5B1%5D%20copy.pdf.

  11. Centre for the Advancement of Interprofessional Education (CAIPE). Interprofessional education – a definition. London: CAIPE Bulletin 13; 1997. p. 19.

    Google Scholar 

  12. Quilici AP, Bicudo AM, Gianotto-Oliveira R, Timerman S, Gutierrez F, Abrão KC. Faculty perceptions of simulation programs in healthcare education. Int J Med Educ. 2015;6:166–71.

    Google Scholar 

  13. Patton M. Utilization-focused evaluation. Los Angeles/London/New Delhi/Singapore: Sage Publishing; 2008. p. 4.

    Google Scholar 

  14. Salas E, Benishek L, Coultas C, Dietz A, Grossman R, Lazzara E. Team training essentials: a research-based guide, vol. 1. New York: Routledge; 2015.

    Google Scholar 

  15. Levett-Jones T, Lapkin S. A systematic review of the effectiveness of simulation debriefing in health professional education. Nurs Educ Today. 2014;34(6):58–63.

    Google Scholar 

  16. Boet S, Bould MD, Bruppacher HR, Desjardins F, Chandra DB, Naik VN. Looking in the mirror: self-debriefing versus instructor debriefing for simulated crises. Crit Care Med. 2011;39(6):1377–81.

    PubMed  Google Scholar 

  17. Savoldelli GL, Naik VN, Park J, Joo HS, Chow R, Hamstra SJ. Value of debriefing during simulated crisis management. Anesthesiology. 2006;105(2):279–85.

    PubMed  Google Scholar 

  18. Welke TM, LeBlanc VR, Savoldelli GL, Joo HS, Chandra DB, Crabtree DB, et al. Personalized oral debriefing versus standardized multimedia instruction after patient crisis simulation. Anesth Analg. 2009;109(1):183–9.

    PubMed  Google Scholar 

  19. Byrne A, Sellen A, Jones J, Aitkenhead A, Hussain S, Gilder F. Effect of videotape feedback on anaesthetists performance while managing simulated anaesthetic crises: a multicentre study. Anaesthesia. 2002;57:176–9.

    CAS  PubMed  Google Scholar 

  20. Dine C, Gersh R, Leary M, Riegel B, Bellini L, Abella B. Improving cardiopulmonary resuscitation quality and resuscitation training by combining audiovisual feedback and debriefing. Crit Care Med. 2008;36:2817–22.

    PubMed  Google Scholar 

  21. Grant JS, Moss J, Epps C, Watts P. Using video-facilitated feedback to improve student performance following high-fidelity simulation. Clin Simul Nurs. 2010;6:177–84.

    Google Scholar 

  22. Van Heukelom J, Begaz T, Treat R. Comparison of postsimulation debriefing versus in-simulation debriefing in medical simulation. Simul Healthc. 2010;5:91–7.

    PubMed  Google Scholar 

  23. Grand JA, Pearce M, Rench TA, Chao GT, Fernandez R, Kozlowski SWJ. Going DEEP: Guidlenies for building simulation-based team assessments. BMJ Qual Saf. 2013;22(5):436–48.

    PubMed  Google Scholar 

  24. Salas E, Cannon-Bowers J, Smith-Jentsch K. Principles and strategies for team training. In: International encyclopedia of ergonomics and human factors, vol. 2. Boca Raton: CRC Press; 2006.

    Google Scholar 

  25. Institute of Medicine. Conceptual framework for measuring the impact of IPE. Measuring the impact of interprofessional education on collaboration and outcomes. Washington, D.C.: The National Academies Press; 2015. p. 25–38.

    Google Scholar 

  26. Kirkpatrick DL. Evaluation of training. In: Craig RL, Bittle LR, editors. Training and development handbook. New York: McGraw-Hill; 1967. p. 87–112.

    Google Scholar 

  27. Thistlethwaite J, Kumar K, Moran M, Saunders R, Carr S. An exploratory review of pre-qualification interprofessional education evaluations. J Interprof Care. 2015;29(4):292–7.

    PubMed  Google Scholar 

  28. Rimando M, Brace AM, Namageyo-Funa A, Parr TL, Sealy D, Davis TL. Data collections challenges and recommendations for early career researchers. Qual Rep. 2015;20(12):2025–36.

    Google Scholar 

  29. Vincenzi DA. Human factors in simulation and training. Boca Raton: CRC Press; 2009.

    Google Scholar 

  30. Azevedo R, Taub M, Mudrick N. Think-aloud protocol analysis. Thousand Oaks: Sage Publications Inc; 2015. p. 764–6.

    Google Scholar 

  31. Ericsson KA, Simon HA. Protocol analysis: verbal reports as data. Cambridge, MA: The MIT Press; 1993.

    Google Scholar 

  32. Shadbolt N. Eliciting expertise. In: Wilson JR, Corlett NE, editors. Evaluation of human work. Boca Raton: Taylor & Francis; 2005. p. 185–218.

    Google Scholar 

  33. Bainbridge L, Sanderson P. Verbal protocol analysis. In: Wilson JR, Corlett EN, editors. Evaluation of human work: a practical ergonomics methodology. 3rd ed. Boca Raton: Taylor & Francis; 2005. p. 159–84.

    Google Scholar 

  34. Flanagan JC. The critical incident technique. Psychol Bull. 1954;51:327–58.

    CAS  PubMed  Google Scholar 

  35. Hassan E. Recall bias can be a threat to retrospective and prospective research designs. Int J Epidemiol. 2006;3(2):4.

    Google Scholar 

  36. Berelson B. Content analysis in communication research. New York: Free Press; 1952.

    Google Scholar 

  37. Nancarrow SA, Booth A, Ariss S, Smith T, Enderby P, Roots A. Ten principles of good interdisciplinary team work. Hum Resour Health. 2013;11(19):1–11.

    Google Scholar 

  38. Given LM, editor. The SAGE encyclopedia of qualitative research methods. 2nd ed. Thousand Oaks: Sage Publications; 2008. p. 108–9.

    Google Scholar 

  39. Trochim W. Concept mapping. In: Mathison S, editor. Encyclopedia of evaluation [Internet]. Thousand Oaks: Sage Publications; 2005. p. 73–4.

    Google Scholar 

  40. Martin-Raugh M, Tannenbaum RJ, Tocci CM, Reese C. Behaviorally anchored rating scales: an application for evaluating teaching practice. Teach Teach Educ. 2016;59:414–9.

    Google Scholar 

  41. Schwab DP, Heneman HG III, DeCotiis TA. Behaviorally anchored rating scales: a review of the literature. Pers Psychol. 1975;28:549–62.

    Google Scholar 

  42. Rarick CA, Baxter G. Behaviorally anchored rating scales (BARS): an effective performance appraisal approach. SAM Adv Manag J. 1986 Jan;51(1):36–9.

    Google Scholar 

  43. Wiersma U, Latham GP. The practicality of behavioral observation scales, behavioral expectation scales, and trait scales. Pers Psychol. 1986;39:619–28.

    Google Scholar 

  44. Fowlkes J, Dwyer DJ, Oser RL, Salas E. Event-based approach to training (EBAT). Int J Aviat Psychol. 1998;8(3):209–21.

    Google Scholar 

  45. Nau HR, editor. Perspectives on international relations. 2nd ed. Washington, D.C.: CQ Press; 2009.

    Google Scholar 

  46. Kozlowski SWJ, Klein KJ. A multilevel approach to theory and research in organizations: contextual, temporal, and emergent processes. In: Klein KJ and Kozlowski SWJ, editors. Multilevel theory, research, and methods in organizations: foundations, extensions, and new directions. San Francisco: Jossey-Bass; 2000. p. 3–90.

    Google Scholar 

  47. Driskell JE, Salas E. Collective behavior and team performance. Hum Factors. 1992;34:277–88.

    Google Scholar 

  48. DeVellis RF. Scale development: theory and applications. 2nd ed. Thousand Oaks: Sage Publications; 2003.

    Google Scholar 

  49. Brannick MT, Prince C. An overview of team performance measurement. In: Brannick MT, Salas E, Prince C, editors. Team performance assessment and measurement. Mahwah: Lawrence Erlbaum; 1997. p. 3–16.

    Google Scholar 

  50. Gillespie R. Manufacturing knowledge: a history of the Hawthorne experiments. Cambridge: Cambridge University Press; 1993.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kristen L. W. Webster .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Webster, K.L.W., Tan, A.C., Unger, N., Lazzara, E.H. (2020). Considerations and Strategies for Assessing: Simulation-Based Training in Interprofessional Education. In: Paige, J., Sonesh, S., Garbee, D., Bonanno, L. (eds) Comprehensive Healthcare Simulation: InterProfessional Team Training and Simulation. Comprehensive Healthcare Simulation. Springer, Cham. https://doi.org/10.1007/978-3-030-28845-7_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-28845-7_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-28844-0

  • Online ISBN: 978-3-030-28845-7

  • eBook Packages: MedicineMedicine (R0)

Publish with us

Policies and ethics