Abstract
In this paper, we developed an intelligent grading system, which scores descriptive examination papers automatically, based on Probabilistic Latent Semantic Analysis (PLSA). For grading, we estimated semantic similarity between a student paper and a model paper. PLSA is able to represent complex semantic structures of given contexts, like text passages, and are used for building linguistic semantic knowledge which could be used in estimating contextual semantic similarity. In this paper, we marked the real examination papers and we can acquire about 74% accuracy of a manual grading, 7% higher than that from the Simple Vector Space Model.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bang, H., Hur, S., Kim, W., Lee, J.: A System to Supplement Subjectivity Test Marking on the Web-based. In: Proceedings of KIPS (2001) (to appear)
Christianini, N., Shawe-Taylor, J., Lodhi, H.: Latent Semantic Kernels. Journal of Intelligent Information System 18(2), 127–152 (2002)
Hofmann, T., Puzicha, J., Jordan, M.: Unsupervised learning from dyadic data. Advances in Neural Information Processing Systems 11 (1999)
Hofmann, T.: Probabilistic latent semantic indexing. In: Proceedings of the 22th Annual International ACM SIGIR conference on Research and Developement in Information Retrieval (SIGIR 1999), pp. 50–57 (1999)
Salton, G., Wong, A., Yang, C.S.: A Vector Space Model for Automatic Indexing. Communication of the ACM 19(11), 613–620 (1975)
Wong, S.K.M., Ziarko, W., Wong, P.C.N.: Generalized vector space model in information retrieval. In: Proceedings of ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 18–25 (1985)
Hofmann, T.: Probabilistic latent semantic analysis. In: Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence, UAI 1999 (1999)
Kang, S.: Hangule Morphological Analyzer, http://nlplab.kookmin.ac.kr
Kim, W.: Ko-Sa-Seong-Eo (Proverbs) Encyclopedia. Eu-Yu Inc (2003) (in Korean)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2004 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kim, YS., Oh, JS., Lee, JY., Chang, JH. (2004). An Intelligent Grading System for Descriptive Examination Papers Based on Probabilistic Latent Semantic Analysis. In: Webb, G.I., Yu, X. (eds) AI 2004: Advances in Artificial Intelligence. AI 2004. Lecture Notes in Computer Science(), vol 3339. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30549-1_114
Download citation
DOI: https://doi.org/10.1007/978-3-540-30549-1_114
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-24059-4
Online ISBN: 978-3-540-30549-1
eBook Packages: Computer ScienceComputer Science (R0)