Skip to main content

Studying Affect Dynamics Using Epistemic Networks

  • Conference paper
  • First Online:
Advances in Quantitative Ethnography (ICQE 2021)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1312))

Included in the following conference series:

Abstract

The study of how affect develops and manifests over time during learning is a popular area of research called affect dynamics. Students’ affective states are recorded in authentic settings like classrooms using direct observations by culturally sensitive, trained, and certified coders. A popular approach to studying affect dynamics in the last decade involved a transition metric called the L statistic. However, recent studies have reported statistical errors and other discrepancies with L statistic leading to questions about its reliability. Thus, we turn to epistemic network analysis (ENA), an emerging technique that is gaining popularity in studying the structure of temporal interconnections between codes. In this paper, we present an alternative approach to study affect dynamics by extending ENA to include directionality in the network edges to capture transitions. We also propose a new approach to running significance tests on network edges to identify significantly likely transitions. Then, we apply the two techniques – L statistic and ENA - to a previously collected affect dataset from a middle school math class, in order to better understand the trade-offs between these methods. Our analysis revealed that ENA could be a promising new approach to conduct affect dynamics analysis. In addition to avoiding statistical errors seen in L statistic, ENA offers better visualization which better emphasizes the magnitude of a transition’s strength. We discuss the assumptions in ENA that need to be vetted further and the possibility for new kinds of analysis in the future for affect dynamics research using ENA.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Baker, R.S.J.D., Rodrigo, M.M.T., Xolocotzin, U.E.: The dynamics of affective transitions in simulation problem-solving environments. In: Paiva, Ana C.R., Prada, R., Picard, Rosalind W. (eds.) ACII 2007. LNCS, vol. 4738, pp. 666–677. Springer, Heidelberg (2007). https://doi.org/10.1007/978-3-540-74889-2_58

    Chapter  Google Scholar 

  2. Baker, R.S., D’Mello, S., Rodrigo, M.M.T., Graesser, A.: Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive-affective states during interactions with 3 different computer-based learning environments. Int. J. Hum Comput Stud. 68(4), 223–241 (2010)

    Article  Google Scholar 

  3. Baker, R.S., Ocumpaugh, J.L., Andres, J.M.A.L.: BROMP quantitative field observations: a review. Learning Science: Theory, Research, and Practice, McGraw-Hill, New York (2020)

    Google Scholar 

  4. Bosch, N., D’Mello, S.: The affective experience of novice computer programmers. Int. J. Artif. Intell. Educ. 27(1), 181–206 (2017)

    Google Scholar 

  5. Bosch, N., Paquette, L.: (under review). What’s next? Edge cases in measuring transitions between sequential states (2020, submitted)

    Google Scholar 

  6. Botelho, A.F., Baker, R., Ocumpaugh, J., Heffernan, N.: Studying affect dynamics and chronometry using sensor-free detectors. In: Proceedings of the 11th International Conference on Educational Data Mining, pp. 157–166 (2018)

    Google Scholar 

  7. D’Mello, S., Person, N., Lehman, B.: Antecedent-consequent relationships and cyclical patterns between affective states and problem solving outcomes. In: AIED, pp. 57–64 (2009)

    Google Scholar 

  8. D’Mello, S., Graesser, A.: Dynamics of Affective states during complex learning. Learn. Instr. 22, 145–157 (2012)

    Article  Google Scholar 

  9. DeFalco, J.A., et al.: Detecting and addressing frustration in a serious game for military training. Int. J. Artif. Intell. Educ. 28(2), 152–193 (2017). https://doi.org/10.1007/s40593-017-0152-1

    Article  Google Scholar 

  10. Karumbaiah, S., Lizarralde, R., Allessio, D., Woolf, B.P., Arroyo, I., Wixon, N.: Addressing student behavior and affect with empathy and growth mindset. In: Educational Data Mining (2017)

    Google Scholar 

  11. Karumbaiah, S., Andres, J. M.A.L., Botelho, A.F., Baker, R.S., Ocumpaugh, J.S.: The implications of a subtle difference in the calculation of affect dynamics. In: 26th International Conference for Computers in Education (2018)

    Google Scholar 

  12. Karumbaiah, S., Baker, Ryan S., Ocumpaugh, J.: The case of self-transitions in affective dynamics. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds.) AIED 2019. LNCS (LNAI), vol. 11625, pp. 172–181. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-23204-7_15

    Chapter  Google Scholar 

  13. Karumbaiah, S., Baker, R. S., Ocumpaugh, J., Andres, J. M.A.L.: A Re-analysis and synthesis of data on affect dynamics in learning (2020, submitted)

    Google Scholar 

  14. Kuppens, P.: It’s about time: A special section on affect dynamics. Emotion Rev. 7(4), 297–300 (2015)

    Article  Google Scholar 

  15. Marquart, C.L., Swiecki, Z., Collier, W., Eagan, B., Woodward, R., Shaffer, D.W.: rENA: epistemic network analysis (2019)

    Google Scholar 

  16. Matayoshi, J., Karumbaiah, S.: Adjusting the L statistic when self-transitions are excluded in affect dynamics. J. Educ. Data Min. 12(4), 1–23 (2020)

    Google Scholar 

  17. McQuiggan, S.W., Lester, J.: Modeling affect expression and recognition in an interactive learning environment. Int. J. Learn. Technol. 4(3–4), 216–233 (2009)

    Article  Google Scholar 

  18. Ferreira Mello, R., Gašević, D.: What is the effect of a dominant code in an epistemic network analysis? In: Eagan, B., Misfeldt, M., Siebert-Evenstone, A. (eds.) ICQE 2019. CCIS, vol. 1112, pp. 66–76. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-33232-7_6

    Chapter  Google Scholar 

  19. Nye, B.D., et al.: Engaging with the scenario: affect and facial patterns from a scenario-based intelligent tutoring system. In: Penstein Rosé, C. (ed.) AIED 2018. LNCS (LNAI), vol. 10947, pp. 352–366. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93843-1_26

    Chapter  Google Scholar 

  20. Okur, E., Aslan, S., Alyuz, N., Arslan Esme, A., Baker, R.S.: Role of socio-cultural differences in labeling students’ affective states. In: Penstein Rosé, C. (ed.) AIED 2018. LNCS (LNAI), vol. 10947, pp. 367–380. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-93843-1_27

    Chapter  Google Scholar 

  21. Rodrigo, M.M.T., Anglo, E., Sugay, J., Baker, R.: Useofun-super- vised clustering to characterize learner behaviors and affective states while using an intelligent tutoring system. In: International Conference on Computers in Education, pp. 57–64 (2008)

    Google Scholar 

  22. Sanghvi, J., Castellano, G., Leite, I., Pereira, A., McOwan, P.W., Paiva, A.: Automatic analysis of affective postures and body motion to detect engagement with a game companion. In: Proceedings of the 6th International Conference on Human-robot Interaction, pp. 305–312. ACM (2011)

    Google Scholar 

  23. Shaffer, D.W., Collier, W., Ruis, A.R.: A tutorial on epistemic network analysis: analyzing the structure of connections in cognitive, social, and interaction data. J. Learn. Anal. 3(3), 9–45 (2016)

    Article  Google Scholar 

Download references

Acknowledgments

We would like to thank the Penn Center for Learning Analytics (PCLA) for supporting this work and the discussions at the 2019 workshop on advanced ENA in the first international conference on quantitative ethnography (ICQE).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shamya Karumbaiah .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Karumbaiah, S., Baker, R.S. (2021). Studying Affect Dynamics Using Epistemic Networks. In: Ruis, A.R., Lee, S.B. (eds) Advances in Quantitative Ethnography. ICQE 2021. Communications in Computer and Information Science, vol 1312. Springer, Cham. https://doi.org/10.1007/978-3-030-67788-6_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-67788-6_25

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-67787-9

  • Online ISBN: 978-3-030-67788-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics