Abstract
This paper addresses lexical ambiguity with focus on a particular problem known as accent prediction, in that given an accentless sequence, we need to restore correct accents. This can be modelled as a sequence classification problem for which variants of Markov chains can be applied. Although the state space is large (about the vocabulary size), it is highly constrained when conditioned on the data observation. We investigate the application of several methods, including Powered Product-of-N-grams, Structured Perceptron and Conditional Random Fields (CRFs). We empirically show in the Vietnamese case that these methods are fairly robust and efficient. The second-order CRFs achieve best results with about 94% term accuracy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Berger, A.L., Della Pietra, S.A., Della Pietra, V.J.: A Maximum Entropy approach to natural language processing. Computational Linguistics 22, 39–71 (1996)
Collins, M.: Discriminative training methods for hidden Markov models: Theory and experiments with the perceptron algorithm. In: Conference on Empirical Methods in Natural Language Processing (EMNLP) (2002)
Dien, D., Kiem, H., Toan, N.V.: Vietnamese Word Segmentation. In: NLPRS 2001, pp. 749–756 (2001)
De Pauw, G., Wagacha, P.W., de Schryver, G.M.: Automatic Diacritic Restoration for Resource-Scarce Languages. In: Matoušek, V., Mautner, P. (eds.) TSD 2007. LNCS (LNAI), vol. 4629. Springer, Heidelberg (2007)
Golding, A.R., Roth, D.: Winnow-Based Approach to Context-Sensitive Spelling Correction. Machine Learning 34, 107–130 (1999)
Kristjannson, T., Culotta, A., Viola, P., McCallum, A.: Interactive information extraction with constrained conditional random fields. In: 19th National Conference on Artificial Intelligence (AAAI), pp. 412–418 (2004)
Lafferty, J., McCallum, A., Pereira, F.: Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In: International Conference on Machine learning (ICML), pp. 282–289 (2001)
Mihalcea, R., Nastase, V.: Letter level learning for language independent diacritics restoration. In: International Conference On Computational Linguistics, pp. 1–7 (2002)
Nelken, R., Shieber, S.M.: Arabic Diacritization Using Weighted Finite-State Transducers. In: ACL Workshop on Computational Approaches to Semitic Languages (2005)
Rabiner, L.R.: A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77, 257–286 (1989)
Robbins, H., Monro, S.: A stochastic approximation method. The Annals of Mathematical Statistics 22, 400–407 (1951)
Simard, M., Deslauriers, A.: Real-time automatic insertion of accents in French text. Natural Language Engineering 7, 143–165 (2001)
Wagacha, P., De Pauw, G., Githinji, P.: A grapheme-based approach for accent prediction in Gıkuyu. In: 5th International Conference on Language Resources and Evaluation, Genoa, Italy, pp. 1937–1940 (2006)
Yarowsky, D.: A comparison of corpus-based techniques for restoring accents in Spanish and French text. In: Natural Language Processing Using Very Large Corpora. Springer, Heidelberg (1999)
Zitouni, I., Sorensen, J.S., Sarikaya, R.: Maximum Entropy based restoration of Arabic diacritics. In: 21st International Conference on Computational Linguistics and the 44th annual meeting of the ACL, pp. 577–584 (2006)
Zweigenbaum, P., Grabar, N.: Restoring accents in unknown biomedical words: application to the French MeSH thesaurus. International Journal of Medical Informatics 67, 113–126 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Truyen, T.T., Phung, D.Q., Venkatesh, S. (2008). Constrained Sequence Classification for Lexical Disambiguation. In: Ho, TB., Zhou, ZH. (eds) PRICAI 2008: Trends in Artificial Intelligence. PRICAI 2008. Lecture Notes in Computer Science(), vol 5351. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-89197-0_40
Download citation
DOI: https://doi.org/10.1007/978-3-540-89197-0_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-89196-3
Online ISBN: 978-3-540-89197-0
eBook Packages: Computer ScienceComputer Science (R0)