Abstract
The recognition performance of current automatic offline handwriting transcription systems is far from being perfect. This is the reason why there is a growing interest in assisted transcription systems, which are more efficient than correcting by hand an automatic transcription. A recent approach to interactive transcription involves multi-modal recognition, where the user can supply an online transcription of some of the words. In this paper, a description of the bimodal engine, which entered the “Bi-modal Handwritten Text Recognition” contest organized during the 2010 ICPR, is presented. The proposed recognition system uses Hidden Markov Models hybridized with neural networks (HMM/ANN) for both offline and online input. The N-best word hypothesis scores for both the offline and the online samples are combined using a log-linear combination, achieving very satisfying results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Vilar, J.M., Castro-Bleda, M.J., Zamora-Martínez, F., España-Boquera, S., Gordo, A., Llorens, D., Marzal, A., Prat, F., Gorbe, J.: A Flexible System for Document Processing and Text Transcription. In: Meseguer, P. (ed.) CAEPIA 2009. LNCS (LNAI), vol. 5988, pp. 291–300. Springer, Heidelberg (2010)
Pastor, M., Vidal, E., Casacuberta, F.: A bi-modal handwritten text corpus. Technical report, Instituto Tecnológico de Informática, Universidad Politécnica de Valencia, Spain (2009)
Marti, U.V., Bunke, H.: The IAM-database: an English sentence database for offline handwriting recognition. International Journal of Document Analysis and Recognition 5, 39–46 (2002)
Liwicki, M., Bunke, H.: IAM-OnDB - an on-line English sentence database acquired from handwritten text on a whiteboard. In: International Conference on Document Analysis and Recognition, pp. 956–961 (2005)
Gorbe-Moya, J., España-Boquera, S., Zamora-Martínez, F.: Castro-Bleda, M.J.: Handwritten Text Normalization by using Local Extrema Classification. In: Proc. 8th International Workshop on Pattern Recognition in Information Systems, Barcelona, Spain, pp. 164–172. Insticc Press (June 2008)
España-Boquera, S., Castro-Bleda, M.J., Gorbe-Moya, J., Zamora-Martínez, F.: Improving Offline Handwritten Text Recognition with Hybrid HMM/ANN Models. IEEE Trans. Pattern Anal. Mach. Intell. (August 2010) (preprints), doi: 10.1109/TPAMI.2010.141
Toselli, A.H., Juan, A., González, J., Salvador, I., Vidal, E., Casacuberta, F., Keysers, D., Ney, H.: Integrated Handwriting Recognition and Interpretation using Finite-State Models. International Journal of Pattern Recognition and Artificial Intelligence 18(4), 519–539 (2004)
España-Boquera, S., Zamora-Martínez, F., Castro-Bleda, M.J., Gorbe-Moya, J.: Efficient BP Algorithms for General Feedforward Neural Networks. In: Mira, J., Álvarez, J.R. (eds.) IWINAC 2007. LNCS, vol. 4527, pp. 327–336. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
España-Boquera, S., Gorbe-Moya, J., Zamora-Martínez, F., Castro-Bleda, M.J. (2010). Hybrid HMM/ANN Models for Bimodal Online and Offline Cursive Word Recognition. In: Ünay, D., Çataltepe, Z., Aksoy, S. (eds) Recognizing Patterns in Signals, Speech, Images and Videos. ICPR 2010. Lecture Notes in Computer Science, vol 6388. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17711-8_2
Download citation
DOI: https://doi.org/10.1007/978-3-642-17711-8_2
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17710-1
Online ISBN: 978-3-642-17711-8
eBook Packages: Computer ScienceComputer Science (R0)