Skip to main content
SpringerLink
Log in

Automated Pitch Convergence Improves Learning in a Social, Teachable Robot for Middle School Mathematics

  • Conference paper
  • First Online:
Artificial Intelligence in Education (AIED 2018)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10947))

Included in the following conference series:

Abstract

Pedagogical agents have the potential to provide not only cognitive support to learners but socio-emotional support through social behavior. Socio-emotional support can be a critical element to a learner’s success, influencing their self-efficacy and motivation. Several social behaviors have been explored with pedagogical agents including facial expressions, movement, and social dialogue; social dialogue has especially been shown to positively influence interactions. In this work, we explore the role of paraverbal social behavior or social behavior in the form of paraverbal cues such as tone of voice and intensity. To do this, we focus on the phenomenon of entrainment, where individuals adapt their paraverbal features of speech to one another. Paraverbal entrainment in human-human studies has been found to be correlated with rapport and learning. In a study with 72 middle school students, we evaluate the effects of entrainment with a teachable robot, a pedagogical agent that learners teach how to solve ratio problems. We explore how a teachable robot which entrains and introduces social dialogue influences rapport and learning; we compare with two baseline conditions: a social condition, in which the robot speaks socially, and a non-social condition, in which the robot neither entrains nor speaks socially. We find that a robot that does entrain and speaks socially results in significantly more learning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Survey questions can be found at www.public.asu.edu/~nlubold/surveys/nico_rapport.pdf

References

  1. Blanchard, E.G., Volfson, B., Hong, Y.J., Lajoie, S.P.: Affective artificial intelligence in education: from detection to adaptation. In: AIED, pp. 81–88. Springer, Heidelberg (2009)

    Google Scholar 

  2. Girard, S., Chavez-Echeagaray, M.E., Gonzalez-Sanchez, J., Hidalgo-Pontet, Y., Zhang, L., Burleson, W., VanLehn, K.: Defining the behavior of an affective learning companion in the affective meta-tutor project. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 21–30. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_3

    Chapter  Google Scholar 

  3. Lane, H.C., Cahill, C., Foutz, S., Auerbach, D., Noren, D., Lussenhop, C., Swartout, W.: The effects of a pedagogical agent for informal science education on learner behaviors and self-efficacy. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 309–318. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_32

    Chapter  Google Scholar 

  4. Afzal, S., Robinson, P.: A study of affect in intelligent tutoring. In: Workshop on Modeling and Scaffolding Affective Experiences to Impact Learning, vol. 57 (2006)

    Google Scholar 

  5. McDaniel, B.T., et al.: Facial features for affective state detection in learning environments. In: Proceedings of the Annual Meeting of the Cognitive Science Society, vol. 29 (2007)

    Google Scholar 

  6. Gulz, A., Haake, M., Silvervarg, A.: Extending a teachable agent with a social conversation module – effects on student experiences and learning. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS (LNAI), vol. 6738, pp. 106–114. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21869-9_16

    Chapter  Google Scholar 

  7. Kumar, R., Ai, H., Beuth, J.L., Rosé, C.P.: Socially capable conversational tutors can be effective in collaborative learning situations. In: Aleven, V., Kay, J., Mostow, J. (eds.) ITS 2010. LNCS, vol. 6094, pp. 156–164. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-13388-6_20

    Chapter  Google Scholar 

  8. Gallois, C., Giles, H.: Communication accommodation theory. The International Encyclopedia of Language and Social Interaction (2015)

    Google Scholar 

  9. Giles, H.: A new theory of the dynamics of speech. Diogenes 106, 119–136 (1979)

    Google Scholar 

  10. Sadoughi, N., Pereira, A., Jain, R., Leite, I., Lehman, J.F.: Creating prosodic synchrony for a robot co-player in a speech-controlled game for children. In: HRI, pp. 91–99. ACM (2017)

    Google Scholar 

  11. Levitan, R., et al.: Implementing acoustic-prosodic entrainment in a conversational avatar. In: INTERSPEECH, vol. 16, pp. 1166–1170 (2016)

    Google Scholar 

  12. Lubold, N., Walker, E., Pon-Barry, H.: Effects of voice-adaptation and social dialogue on perceptions of a robotic learning companion. In: HRI, pp. 255–262. IEEE (2016)

    Google Scholar 

  13. Roscoe, R.D., Chi, M.T.: Understanding tutor learning: knowledge-building and knowledge-telling in peer tutors’ explanations and questions. Rev. Educ. Res. 77(4), 534–574 (2007)

    Google Scholar 

  14. Leelawong, K., Biswas, G.: Designing learning by teaching agents: the betty’s brain system. Int. J. Artif. Intell. Educ. 18(3), 181–208 (2008)

    Google Scholar 

  15. Pareto, L., Arvemo, T., Dahl, Y., Haake, M., Gulz, A.: A teachable-agent arithmetic game’s effects on mathematics understanding, attitude and self-efficacy. In: Biswas, G., Bull, S., Kay, J., Mitrovic, A. (eds.) AIED 2011. LNCS (LNAI), vol. 6738, pp. 247–255. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21869-9_33

    Chapter  Google Scholar 

  16. Ogan, A., et al.: Oh dear stacy!: social interaction, elaboration, and learning with teachable agents. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 39–48. ACM (2012)

    Google Scholar 

  17. Biswas, G., Jeong, H., Kinnebrew, J.S., Sulcer, B., Roscoe, R.: Measuring self-regulated learning skills through social interactions in a teachable agent environment. Res. Pract. Technol. Enhanced Learn. 5(02), 123–152 (2011)

    Article  Google Scholar 

  18. Chase, C.C., Chin, D.B., Oppezzo, M.A., Schwartz, D.L.: Teachable agents and the protégé effect: increasing the effort towards learning. J. Sci. Educ. Technol. 18(4), 334–352 (2009)

    Article  Google Scholar 

  19. Hood, D., Lemaignan, S., Dillenbourg, P.: When children teach a robot to write: an autonomous teachable humanoid uses simulated handwriting. In: HRI, pp. 83–90. ACM (2015)

    Google Scholar 

  20. Tanaka, F., Matsuzoe, S.: Children teach a care-receiving robot to promote their learning: field experiments in a classroom for vocabulary learning. J. Hum.-Robot Interact. 1(1) (2012)

    Google Scholar 

  21. Arroyo, I., et al.: Affective gendered learning companions. In: AIED, pp. 21–48 (2009)

    Google Scholar 

  22. Liu, P., Glas, D.F., Kanda, T., Ishiguro, H., Hagita, N.: It’s not polite to point: generating socially appropriate deictic behaviors towards people. In: HRI, pp. 267–274. IEEE (2013)

    Google Scholar 

  23. Westlund, K., et al.: Flat vs. expressive storytelling: young children’s learning and retention of a social robot’s narrative. Front. Hum. Neurosci. 11, 295 (2017)

    Article  Google Scholar 

  24. Pezzullo, L.G., Wiggins, J.B., Frankosky, M.H., Min, W., Boyer, K.E., Mott, B.W., Wiebe, E.N., Lester, J.C.: “Thanks Alisha, keep in touch”: gender effects and engagement with virtual learning companions. In: André, E., Baker, R., Hu, X., Rodrigo, M.M.T., du Boulay, B. (eds.) AIED 2017. LNCS (LNAI), vol. 10331, pp. 299–310. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-61425-0_25

    Chapter  Google Scholar 

  25. Thomason, J., Nguyen, H.V., Litman, D.: Prosodic entrainment and tutoring dialogue success. In: Lane, H.C., Yacef, K., Mostow, J., Pavlik, P. (eds.) AIED 2013. LNCS (LNAI), vol. 7926, pp. 750–753. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-39112-5_104

    Chapter  Google Scholar 

  26. Sinha, T., Cassell, J.: We click, we align, we learn: impact of influence and convergence processes on student learning and rapport building. In: Proceedings of the 1st Workshop on Modeling INTERPERsonal SynchrONy And infLuence, pp. 13–20. ACM (2015)

    Google Scholar 

  27. Lubold, N., Pon-Barry, H.: Acoustic-prosodic entrainment and rapport in collaborative learning dialogues. In: Proceedings of the 2014 ACM Workshop on Multimodal Learning Analytics Workshop and Grand Challenge, pp. 5–12. ACM (2014)

    Google Scholar 

  28. Tickle-Degnen, L., Rosenthal, R.: The nature of rapport and its nonverbal correlates. Psychol. Inq. 1(4), 285–293 (1990)

    Article  Google Scholar 

  29. Common Core State Standards Initiative. Common Core State Standards for Mathematics. National Governors Association Center for Best Practices and the Council of Chief State School Officers, Washington, DC (2010)

    Google Scholar 

  30. Spencer-Oatey, H.: (Im) Politeness, face and perceptions of rapport: unpackaging their bases and interrelationships. Politeness Res. 1(1)(Im), 95–119 (2005)

    Google Scholar 

  31. Bell, D., Arnold, H., Haddock, R.: Linguistic politeness and peer tutoring. Learn. Assistance Rev. 14(1), pp. 37–54 (2009)

    Google Scholar 

  32. Lubold, N., Walker, E., Pon-Barry, H.: Naturalness and rapport in a pitch adaptive learning companion. In: ASRU, pp. 103–110. IEEE (2015)

    Google Scholar 

  33. Burleson, W., Picard, R.: Gender-specific approaches to developing emotionally intelligent learning companions. IEEE Intell. Syst. 22(4) (2007)

    Google Scholar 

  34. Saerbeck, M., Schut, T., Bartneck, C., Janse, M.D.: Expressive robots in education: varying the degree of social supportive behavior of a robotic tutor. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1613–1622. ACM (2010)

    Google Scholar 

  35. Pickering, M.J., Garrod, S.: An integrated theory of language production and comprehension. Behav. Brain Sci. 36(4), 329–347 (2013)

    Article  Google Scholar 

  36. Hake, R.R.: Relationship of individual student normalized learning gains in mechanics with gender, high-school physics, and pretest scores on mathematics and spatial visualization. In: Physics Education Research Conference, pp. 30–45, (2002)

    Google Scholar 

  37. Maldonado, H., et al.: We learn better together: enhancing elearning with emotional characters. In: CSCL, pp. 408–417. International Society of the Learning Sciences (2005)

    Google Scholar 

  38. Wang, N., et al.: the politeness effect. Int. J. Hum Comput Stud. 66, 96–112 (2008)

    Article  Google Scholar 

  39. Litman, D.J., et al.: Spoken versus typed human and computer dialogue tutoring. Int. J. Artif. Intell. Educ. 16(2), 145–170 (2006)

    Google Scholar 

  40. Rosé, C.P., Bhembe, D., Siler, S., Srivastava, R., VanLehn, K.: The role of why questions in effective human tutoring. In: Hoppe, U., Verdejo, F., Kay, J. (eds.) AIED (2003)

    Google Scholar 

  41. Wallace, R.: The elements of AIML style. Alice AI Foundation (2003)

    Google Scholar 

  42. Kim, Y., Baylor, A., Shen, E.: Pedagogical agents as learning companions: the impact of agent emotion and gender. J. Comput. Assist. Learn. 23(3), 220–234 (2007)

    Article  Google Scholar 

  43. Spencer-Oatey, H.: Managing rapport in talk: using rapport sensitive incidents to explore the motivational concerns underlying the management of relations. J. Pragmat. 34(5), 529–545 (2002)

    Article  Google Scholar 

Download references

Acknowledgements

This work is supported by the National Robotics Initiative and the National Science Foundation, grant # CISE-IIS-1637809. We would also like to thank Samantha Baker and Ishrat Ahmed for their help in setting up this study and the data collection process.

Author information

Authors and Affiliations

  1. Arizona State University, Tempe, AZ, 85281, USA

    Nichola Lubold & Erin Walker

  2. Mount Holyoke College, South Hadley, MA, 01075, USA

    Heather Pon-Barry

  3. Carnegie Mellon University, Pittsburgh, PA, 15213, USA

    Amy Ogan

Authors
  1. Nichola Lubold
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Erin Walker
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Heather Pon-Barry
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Amy Ogan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nichola Lubold .

Editor information

Editors and Affiliations

  1. Carnegie Mellon University, Pittsburgh, PA, USA

    Carolyn Penstein Rosé

  2. University of Technology, Sydney, NSW, Australia

    Roberto Martínez-Maldonado

  3. University of Duisburg-Essen, Duisburg, Germany

    H. Ulrich Hoppe

  4. UCL Institute of Education, London, UK

    Rose Luckin

  5. UCL Institute of Education, London, UK

    Manolis Mavrikis

  6. UCL Institute of Education, London, UK

    Kaska Porayska-Pomsta

  7. Carnegie Mellon University, Pittsburgh, PA, USA

    Bruce McLaren

  8. University of Sussex, Brighton, UK

    Benedict du Boulay

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Lubold, N., Walker, E., Pon-Barry, H., Ogan, A. (2018). Automated Pitch Convergence Improves Learning in a Social, Teachable Robot for Middle School Mathematics. In: Penstein Rosé, C., et al. Artificial Intelligence in Education. AIED 2018. Lecture Notes in Computer Science(), vol 10947. Springer, Cham. https://doi.org/10.1007/978-3-319-93843-1_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-93843-1_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-93842-4

  • Online ISBN: 978-3-319-93843-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation