Skip to main content
SpringerLink
Log in

Letting the Genie Out of the Lamp: Using Natural Language Processing Tools to Predict Math Performance

  • Conference paper
  • First Online:
Language, Data, and Knowledge (LDK 2017)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10318))

Included in the following conference series:

Abstract

This study examines links between natural language processing and its application in math education. Specifically, the study examines language production and math success in an on-line, blended learning math program. Unlike previous studies that have relied on correlational analyses between linguistic knowledge tests and standardized math tests or compared math success between proficient and non-proficient speakers of English, this study examines the linguistic features of students’ language production while e-mailing a virtual pedagogical agent. In addition, the study examines a number of non-linguistic features such as grade and objective met within the program. The findings indicate that linguistic features related to the use of standardized language use explain around 8% of math success. These linguistic features outperform non-linguistic features.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. LeFevre, J.A., Fast, L., Skwarchuk, S.L., Smith-Chant, B.L., Bisanz, J., Kamawar, D., Penner-Wilger, M.: Pathways to math: longitudinal predictors of performance. Child Dev. 81(6), 1753–1767 (2010). doi:10.1111/j.1467-8624.2010.01508.x

    Article  Google Scholar 

  2. Vukovic, R.K., Lesaux, N.K.: The relationship between linguistic skills and arithmetic knowledge. Learn. Individ. Diff. 23, 87–91 (2013). doi:10.1016/j.lindif.2012.10.007

    Article  Google Scholar 

  3. Martiniello, M.: Language and the performance of English-language learners in math word problems. Harv. Educ. Rev. 78(2), 333–368 (2008)

    Article  Google Scholar 

  4. Adams, T.L.: Reading math: more than words can say. Read. Teach. 56(8), 786–795 (2003)

    Google Scholar 

  5. MacGregor, M., Price, E.: An exploration of aspects of language proficiency and algebra learning. J. Res. Math. Educ. 30, 449–467 (1999). doi:10.2307/749709

    Article  Google Scholar 

  6. Alt, M., Arizmendi, G.D., Beal, C.R.: The relationship between math and language: academic implications for children with specific language impairment and English language learners. Lang. Speech Hear. Serv. Sch. 45(3), 220–233 (2014). doi:10.1044/2014_LSHSS-13-0003

    Article  Google Scholar 

  7. Hampden-Thompson, G., Mulligan, G., Kinukawa, A., Halle, T.: Math Achievement of Language-Minority Students During the Elementary Years. U.S. Department of Education, National Center for Education Statistics, Washington, DC (2008)

    Google Scholar 

  8. Martiniello, M.: Linguistic complexity, schematic representations, and differential item functioning for English language learners in math tests. Educ. Assess. 14(3–4), 160–179 (2009). doi:10.1080/10627190903422906

    Article  Google Scholar 

  9. Crossley, S.A., Liu, R., McNamara, D.: Predicting math performance using natural language processing tools. In: Proceedings of the 7th International Learning Analytics and Knowledge (LAK) Conference. ACM, New York (2017)

    Google Scholar 

  10. Hernandez, F.: The relationship between reading and math achievement of middle school students as measured by the Texas assessment of knowledge and skills. Doctoral dissertation (2013)

    Google Scholar 

  11. Cummins, J.: Linguistic interdependence and the educational development of bilingual children. Rev. Educ. Res. 49(2), 222–251 (1979)

    Article  Google Scholar 

  12. Ardasheva, Y., Tretter, T.R., Kinny, M.: English language learners and academic achievement: revisiting the threshold hypothesis. Lang. Learn. 62(3), 769–812 (2012). doi:10.1111/j.1467-9922.2011.00652.x

    Article  Google Scholar 

  13. Mosqueda, E., Maldonado, S.I.: The effects of English language proficiency and curricular pathways: Latina/os’ math achievement in secondary schools. Equity Excell. Educ. 46(2), 202–219 (2013). doi:10.1080/10665684.2013.780647

    Article  Google Scholar 

  14. Wang, J., Goldschmidt, P.: Opportunity to learn, language proficiency, and immigrant status effects on math achievement. J. Educ. Res. 93(2), 101–111 (1999). doi:10.1080/00220679909597634

    Article  Google Scholar 

  15. Chen, F., Chalhoub-Deville, M.: Differential and long-term language impact on math. Lang. Test. 33(4), 577–605 (2015)

    Article  Google Scholar 

  16. Khachatryan, G.A., Romashov, A.V., Khachatryan, A.R., Gaudino, S.J., Khachatryan, J.M., Guarian, K.R., Yufa, N.V.: Reasoning Mind Genie 2: an intelligent tutoring system as a vehicle for international transfer of instructional methods in mathematics. Int. J. Artif. Intell. Educ. 24(3), 333–382 (2014). doi:10.1007/s40593-014-0019-7

    Article  Google Scholar 

  17. Kyle, K., Crossley, S.A.: Automatically assessing lexical sophistication: indices, tools, findings, and application. TESOL Q. 49(4), 757–786 (2015). doi:10.1002/tesq.194

    Article  Google Scholar 

  18. Crossley, S.A., Kyle, K., McNamara, D.S.: The tool for the automatic analysis of text cohesion (TAACO): automatic assessment of local, global, and text cohesion. Behav. Res. Methods 48(4), 1227–1237 (2016)

    Article  Google Scholar 

  19. Crossley, S.A., Kyle, K., McNamara, D.S.: Sentiment analysis and social cognition engine (SEANCE): an automatic tool for sentiment, social cognition, and social order analysis. Behav. Res. Methods (in press). doi:10.3758/s13428-016-0743-z

  20. Thorndike, E.L., Lorge, I.: The Teacher’s Wordbook of 30,000 Words. Teachers College: Bureau of Publications: Columbia University, New York (1944)

    Google Scholar 

  21. Kučera, H., Francis, N.: Computational Analysis of Present-Day American English. Brown University Press, Providence (1967)

    Google Scholar 

  22. Brown, G.D.: A frequency count of 190,000 words in the London-Lund Corpus of English conversation. Behav. Res. Methods Instr. Comput. 16(6), 502–532 (1984). doi:10.3758/BF03200836

    Article  Google Scholar 

  23. Brysbaert, M., New, B.: Subtlexus: American word frequencies (2009). http://subtlexus.lexique.org

  24. The British National Corpus, Version 3 (BNC XML Edition) 2007 Distributed by Oxford University Computing Services on Behalf of the BNC Consortium. http://www.natcorp.ox.ac.uk/

  25. Davies, M.: The 385+ million word Corpus of Contemporary American English (1990–2008+): design, architecture, and linguistic insights. Int. J. Corpus Linguist. 14, 159–190 (2009). doi:10.1075/ijcl.14.2.02dav

    Article  Google Scholar 

  26. Coltheart, M.: The MRC psycholinguistic database. Q. J. Exp. Psychol. 33(4), 497–505 (1981)

    Article  Google Scholar 

  27. Kuperman, V., Stadthagen-Gonzalez, H., Brysbaert, M.: Age-of-acquisition ratings for 30,000 English words. Behav. Res. Methods 44(4), 978–990 (2012). doi:10.3758/s13428-012-0210-4

    Article  Google Scholar 

  28. Brysbaert, M., Warriner, A.B., Kuperman, V.: Concreteness ratings for 40 thousand generally known English word lemmas. Behav. Res. Methods 46(3), 904–911 (2014). doi:10.3758/s13428-013-0403-5

    Article  Google Scholar 

  29. Miller, G.A.: WordNet: a lexical database for English. Commun. ACM 38(11), 39–41 (1995). doi:10.1145/219717.219748

    Article  Google Scholar 

  30. Kiss, G.R., Armstrong, C., Milroy, R., Piper, J.: An associative thesaurus of English and its computer analysis. In: Aitken, A.J., Bailey, R.W., Hamilton-Smith, N. (eds.) The Computer and Literary Studies, pp. 153–165. Edinburgh University Press, Edinburgh (1973)

    Google Scholar 

  31. Nelson, D.L., McEvoy, C. L., Schreiber, T.A.: The University of South Florida word association, rhyme, and word fragment norms (1998). http://www.usf.edu/FreeAssociation/

  32. Balota, D.A., Yap, M.J., Cortese, M.J., Hutchison, K.I., Kessler, B., Loftis, B., et al.: The English lexicon project. Behav. Res. Methods 39, 445–459 (2007)

    Article  Google Scholar 

  33. Bird, S., Klein, E., Loper, E.: Natural Language Processing with Python. O’Reilly Media, Inc., Sebastopol (2009)

    MATH  Google Scholar 

  34. R Core Team: R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. (2014). http://www.R-project.org/

  35. Grömping, U.: Relative importance for linear regression in R: the package relaimpo. J. Stat. Softw. 1(1) (2006)

    Google Scholar 

Download references

Acknowledgements

This research was supported in part by NSF 1623730. Opinions, conclusions, or recommendations do not necessarily reflect the views of the NSF.

Author information

Authors and Affiliations

  1. Applied Linguistics and ESL, Georgia State University, Atlanta, GA, USA

    Scott Crossley

  2. Reasoning Mind, Houston, TX, USA

    Victor Kostyuk

Authors
  1. Scott Crossley
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Victor Kostyuk
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Scott Crossley or Victor Kostyuk .

Editor information

Editors and Affiliations

  1. Universidad Politécnica de Madrid, Madrid, Spain

    Jorge Gracia

  2. Nanyang Technological University, Singapore, Singapore

    Francis Bond

  3. Insight Centre for Data Analytics, National University of Ireland, Galway, Galway, Ireland

    John P. McCrae

  4. Insight Centre for Data Analytics, National University of Ireland, Galway, Ireland

    Paul Buitelaar

  5. Goethe-University Frankfurt, Frankfurt, Germany

    Christian Chiarcos

  6. University of Leipzig, Leipzig, Germany

    Sebastian Hellmann

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Crossley, S., Kostyuk, V. (2017). Letting the Genie Out of the Lamp: Using Natural Language Processing Tools to Predict Math Performance. In: Gracia, J., Bond, F., McCrae, J., Buitelaar, P., Chiarcos, C., Hellmann, S. (eds) Language, Data, and Knowledge. LDK 2017. Lecture Notes in Computer Science(), vol 10318. Springer, Cham. https://doi.org/10.1007/978-3-319-59888-8_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-59888-8_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-59887-1

  • Online ISBN: 978-3-319-59888-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation