Skip to main content
SpringerLink
Log in

Using Machine Learning to Overcome the Expert Blind Spot for Perceptual Fluency Trainings

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2019)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11625))

Included in the following conference series:

Abstract

Most STEM domains use multiple visual representations to illustrate complex concepts. While much research has focused on helping students make sense of visuals, students also have to become perceptually fluent at translating among visuals fast and effortlessly. Because perceptual fluency is acquired via implicit, nonverbal processes, perceptual fluency trainings provide simple classification tasks that vary visual features across numerous examples. Prior research shows that learning from such trainings is strongly affected by the sequence of the examples. Further, prior research shows that perceptual fluency trainings are most effective for high-performing students but may confuse low-performing students. We propose that a lack of benefits for low-performing students may result from a perceptual expert blind spot of instructors who typically develop perceptual fluency trainings: expert instructors may be unable to anticipate the needs of students who do not see meaningful information in the visuals. In prior work, we used a machine-learning approach to develop a sequence of example visuals of chemical molecules for low-performing students. This study tested the effectiveness of this sequence in comparison to an expert-generated sequence in a randomized experiment as part of an undergraduate chemistry course. We determined students’ performance based on log data from an educational technology they used in the course. Results show that the machine-learned sequence was more effective for low-performing students. The expert sequence was more effective for high-performing students. Our results can inform the development of perceptual-fluency trainings for adaptive educational technologies.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 119.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Gilbert, J.K.: Visualization: an emergent field of practice and inquiry in science education. In: Gilbert, J.K., Reiner, M., Nakhleh, M.B. (eds.) Visualization: Theory and Practice in Science Education, vol. 3, pp. 3–24. Springer, Dordrecht (2008). https://doi.org/10.1007/978-1-4020-5267-5_1

    Chapter  Google Scholar 

  2. Ainsworth, S.: The educational value of multiple-representations when learning complex scientific concepts. In: Gilbert, J.K., Reiner, M., Nakama, A. (eds.) Visualization: Theory and Practice in Science Education, pp. 191–208. Springer, Dordrecht (2008). https://doi.org/10.1007/978-1-4020-5267-5_9

    Chapter  Google Scholar 

  3. NRC: Learning to Think Spatially. National Academies Press, Washington, D.C. (2006)

    Google Scholar 

  4. Rau, M.A., Michaelis, J.E., Fay, N.: Connection making between multiple graphical representations: a multi-methods approach for domain-specific grounding of an intelligent tutoring system for chemistry. Comput. Educ. 82, 460–485 (2015)

    Article  Google Scholar 

  5. Ainsworth, S.: DeFT: a conceptual framework for considering learning with multiple representations. Learn. Instr. 16, 183–198 (2006)

    Article  Google Scholar 

  6. McElhaney, K.W., Chang, H.Y., Chiu, J.L., Linn, M.C.: Evidence for effective uses of dynamic visualisations in science curriculum materials. Stud. Sci. Educ. 51, 49–85 (2015)

    Article  Google Scholar 

  7. Rau, M.A.: Conditions for the effectiveness of multiple visual representations in enhancing STEM learning. Educ. Psychol. Rev. 29, 717–761 (2017)

    Article  Google Scholar 

  8. Rau, M.A., Aleven, V., Rummel, N.: Successful learning with multiple graphical representations and self-explanation prompts. J. Educ. Psychol. 107, 30–46 (2015)

    Article  Google Scholar 

  9. Seufert, T., Brünken, R.: Cognitive load and the format of instructional aids for coherence formation. Appl. Cogn. Psychol. 20, 321–331 (2006)

    Article  Google Scholar 

  10. Bodemer, D., Faust, U.: External and mental referencing of multiple representations. Comput. Hum. Behav. 22, 27–42 (2006)

    Article  Google Scholar 

  11. Kellman, P.J., Massey, C.M.: Perceptual learning, cognition, and expertise. In: Ross, B.H. (ed.) The Psychology of Learning and Motivation, vol. 558, pp. 117–165. Elsevier Academic Press, New York (2013)

    Google Scholar 

  12. Goldstone, R.L., Barsalou, L.W.: Reuniting perception and conception. Cognition 65, 231–262 (1998)

    Article  Google Scholar 

  13. Kellman, P.J., Garrigan, P.B.: Perceptual learning and human expertise. Physics Life Rev. 6, 53–84 (2009)

    Article  Google Scholar 

  14. Goldstone, R.L., Schyns, P.G., Medin, D.L.: Learning to bridge between perception and cognition. Psychol. Learn. Motiv. 36, 1–14 (1997)

    Article  Google Scholar 

  15. Gibson, E.J.: Perceptual learning in development: some basic concepts. Ecol. Psychol. 12, 295–302 (2000)

    Article  Google Scholar 

  16. Goldstone, R.: Perceptual Learning. Academic Press, San Diego (1997)

    Google Scholar 

  17. Rau, M.A., Wu, S.P.W.: Support for sense-making processes and inductive processes in connection-making among multiple visual representations. Cogn. Instr. 36, 361–395 (2018)

    Article  Google Scholar 

  18. Rau, M.A.: Sequencing support for sense making and perceptual induction of connections among multiple visual representations. J. Educ. Psychol. 110, 811–833 (2018)

    Article  Google Scholar 

  19. Schooler, J.W., Fiore, S., Brandimonte, M.A.: At a loss from words: verbal overshadowing of perceptual memories. Psychol. Learn. Motiv. Adv. Res. Theor. 37, 291–340 (1997)

    Article  Google Scholar 

  20. Goldstone, R.L., Landy, D.H., Son, J.Y.: The education of perception. Top. Cogn. Sci. 2, 265–284 (2010)

    Article  Google Scholar 

  21. Gibson, E.J.: Principles of Perceptual Learning and Development. Prentice Hall, New York (1969)

    Google Scholar 

  22. Chase, W.G., Simon, H.A.: Perception in chess. Cogn. Psychol. 4, 55–81 (1973)

    Article  Google Scholar 

  23. Richman, H.B., Gobet, F., Staszewski, J.J., Simon, H.A.: Perceptual and memory processes in the acquisition of expert performance: the EPAM model. In: Ericsson, K.A. (ed.) The Road to Excellence? The Acquisition of Expert Performance in the Arts and Sciences, Sports and Games, pp. 167–187. Erlbaum Associates, Mahwah (1996)

    Google Scholar 

  24. Taber, K.S.: Revisiting the chemistry triplet: drawing upon the nature of chemical knowledge and the psychology of learning to inform chemistry education. Chem. Educ. Res. Pract. 14, 156–168 (2013)

    Article  Google Scholar 

  25. Koedinger, K.R., Corbett, A.T., Perfetti, C.: The knowledge-learning-instruction framework: bridging the science-practice chasm to enhance robust student learning. Cogn. Sci. 36, 757–798 (2012)

    Article  Google Scholar 

  26. Shanks, D.: Implicit learning. In: Lamberts, K., Goldstone, R. (eds.) Handbook of Cognition, pp. 202–220. Sage, London (2005)

    Google Scholar 

  27. Massey, C.M., Kellman, P.J., Roth, Z., Burke, T.: Perceptual learning and adaptive learning technology - developing new approaches to mathematics learning in the classroom. In: Stein, N.L., Raudenbush, S.W. (eds.) Developmental Cognitive Science Goes to School, pp. 235–249. Routledge, New York (2011)

    Google Scholar 

  28. Rau, M.A., Aleven, V., Rummel, N.: Interleaved practice in multi-dimensional learning tasks: which dimension should we interleave? Learn. Instr. 23, 98–114 (2013)

    Article  Google Scholar 

  29. Rau, M.A., Aleven, V., Rummel, N., Pardos, Z.: How should intelligent tutoring systems sequence multiple graphical representations of fractions? A multi-methods study. Int. J. Artif. Intell. Educ. 24, 125–161 (2014)

    Article  Google Scholar 

  30. Bradley, J.-C., Lancashire, R., Lang, A., Williams, A.: The spectral game: leveraging open data and crowdsourcing for education. J. Cheminform. 1, 1–10 (2009)

    Article  Google Scholar 

  31. Rau, M.A., Aleven, V., Rummel, N.: Supporting students in making sense of connections and in becoming perceptually fluent in making connections among multiple graphical representations. J. Educ. Psychol. 109, 355–373 (2017)

    Article  Google Scholar 

  32. Kellman, P.J., et al.: Perceptual learning and the technology of expertise: studies in fraction learning and algebra. Pragmat. Cogn. 16, 356–405 (2008)

    Article  Google Scholar 

  33. Wise, J.A., Kubose, T., Chang, N., Russell, A., Kellman, P.J.: Perceptual learning modules in mathematics and science instruction. In: Hoffman, P., Lemke, D. (eds.) Teaching and Learning in a Network World, pp. 169–176. IOS Press, Amsterdam (2000)

    Google Scholar 

  34. Kellman, P.J., Massey, C.M., Son, J.Y.: Perceptual learning modules in mathematics: enhancing students’ pattern recognition, structure extraction, and fluency. Top. Cogn. Sci. 2, 285–305 (2009)

    Article  Google Scholar 

  35. Nathan, M.J., Koedinger, K.R., Alibali, M.W.: Expert blind spot: when content knowledge eclipses pedagogical content knowledge. In: Chen, L., et al. (eds.) Proceedings of the Third International Conference on Cognitive Science, pp. 644–648. USTC Press, Beijing (2001)

    Google Scholar 

  36. Chin, J.M., Schooler, J.W.: Why do words hurt? Content, process, and criterion shift accounts of verbal overshadowing. Eur. J. Cogn. Psychol. 20, 396–413 (2008)

    Article  Google Scholar 

  37. Zhu, X.: Machine teaching: an inverse problem to machine learning and an approach toward optimal education. In: AAAI Conference on Artificial Intelligence (2015)

    Google Scholar 

  38. Sen, A., et al.: Machine beats human at finding the optimal sequence of visual representations for students learning of perceptual fluency. In: Boyer, K.E., Yudelson, M. (eds.) Proceedings of the 11th International Conference on Educational Data Mining, pp. 137–146. International Educational Data Mining Society, Buffalo (2018)

    Google Scholar 

  39. VanLehn, K.: The relative effectiveness of human tutoring, intelligent tutoring systems and other tutoring systems. Educ. Psychol. 46, 197–221 (2011)

    Article  Google Scholar 

  40. Rau, M.A., Mason, B., Nowak, R.: How to model implicit knowledge? Use of metric learning to assess student perceptions of visual representations. In: Barnes, T., Chi, M., Feng, M. (eds.) Proceedings of the 9th International Conference on Educational Data Mining, pp. 199–206. International Educational Data Mining Society, Raleigh (2016)

    Google Scholar 

  41. Van Gog, T., Paas, F.: Instructional efficiency: revisiting the original construct in educational research. Educ. Psychol. 43, 16–26 (2008)

    Article  Google Scholar 

  42. Cohen, J.: Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum Associates, Hillsdale (1988)

    MATH  Google Scholar 

  43. Park, O., Lee, J.: Adaptive instructional systems. In: Jonassen, D.H. (ed.) Handbook of Research for Educational Communications and Technology, pp. 651–658. Erlbaum, Mahwah (2003)

    Google Scholar 

Download references

Acknowledgements

This research was funded by NSF IIS 1623605 and by NSF ITP 1545481. We thank Yuzi Yu, Blake Mason, John Moore, Rob Nowak, Purav Patel, and Tim Rogers.

Author information

Authors and Affiliations

  1. University of Wisconsin – Madison, 1025 W Johnson Street, Madison, WI, 53706, USA

    Martina A. Rau, Ayon Sen & Xiaojin Zhu

Authors
  1. Martina A. Rau
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ayon Sen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaojin Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Martina A. Rau .

Editor information

Editors and Affiliations

  1. University of Sao Paulo, Sao Paulo, Brazil

    Seiji Isotani

  2. University of Malaga, Málaga, Spain

    Eva Millán

  3. Carnegie Mellon University, Pittsburgh, PA, USA

    Amy Ogan

  4. DePaul University, Chicago, IL, USA

    Peter Hastings

  5. Carnegie Mellon University, Pittsburgh, PA, USA

    Bruce McLaren

  6. University College London, London, UK

    Rose Luckin

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rau, M.A., Sen, A., Zhu, X. (2019). Using Machine Learning to Overcome the Expert Blind Spot for Perceptual Fluency Trainings. In: Isotani, S., Millán, E., Ogan, A., Hastings, P., McLaren, B., Luckin, R. (eds) Artificial Intelligence in Education. AIED 2019. Lecture Notes in Computer Science(), vol 11625. Springer, Cham. https://doi.org/10.1007/978-3-030-23204-7_34

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-23204-7_34

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-23203-0

  • Online ISBN: 978-3-030-23204-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation