Abstract
We propose in this paper a novel approach which makes self-organizing maps (SOM) and the Hidden Markov Models (HMMs) cooperate. Our approach (SOS-HMM: Self Organizing Structure of HMM) allows to learn the Hidden Markov Models topology. The main contribution for the proposed approach is to automatically extract the structure of a hidden Markov model without any prior knowledge of the application domain. This model can be represented as a graph of macro-states, where each state represents a micro model. Experimental results illustrate the advantages of the proposed approach compared to a fixed structure approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Asuncion, A., Newman, D.: UCI machinelearning repository (2007), http://www.ics.uci.edu/mlearn/MLRepository.html
Baum, E.L., Petrie, T., Soules, G., Weiss, N.: A maximization technique occurring in the statistical analysis of probabilistic functions of markov chains. The Annals of Mathematical Statistics 41, 164–171 (1970)
Ferles, C., Stafylopatis, A.: Sequence clustering with the Self-Organizing Hidden Markov Model Map. In: 8th IEEE International Conference, pp. 1–7 (2008)
Ferles, C., Stafylopatis, A.: A Hybrid Self-Organizing Model for Sequence Analysis. In: 20th IEEE International Conference on Tools with Artificial Intelligence, pp. 105–112, Washington, DC, USA (2008)
Chavent, M.A.: Monothetic clustering method. Pattern Recognition Letters 19, 989–996 (1998)
Durbin, R., Eddy, S., Krogh, A., Mitchison, G.: Biological Sequence Analysis. Cambridge University Press, Cambridge (1998)
Freitag, D., McCallum, A.: Information extraction with HMMs and shrinkage. In: Proc. of the AAAI Workshop on Machine Learning for Information Extraction (1999)
Freitag, D., McCallum, A.: Information extraction with HMM structures learned by stochastic optimization. In: Proc of the Seventeenth National Conference on Artificial Intelligence, AAAI, pp. 584–589, (2000)
Kohonen, T.: Self-Organizing Map. Springer, Heidelberg (1995)
Levin, E., Pieraccini, R.: Planar Hidden Markov modeling: from speech to optical character recognition. In: Giles, C., Hanton, S., Cowan, J. (eds.) Advances in Neural Information Processing Systems, vol. 5, pp. 731–738. Morgan Kauffman, San Francisco (1993)
Rabiner, R.: A tutorial on hidden markov models and selected applications. In: speech recognition. Proceedings of the IEEE 77(2), 257–286 (1989)
Rogovschi, N., Lebbah, M., Bennani, Y.: Learning Self-Organizing Mixture Markov Models. Journal of Nonlinear Systems and Applications, JNSA (2010) ISSN. 1918-3704
Viterbi, A.J.: Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Transactions on Information Theory, 260–267 (1967)
Zehraoui, F., Bennani, Y.: New self-organising maps for multivariate sequences processing. International Journal of Computational Intelligence and Applications 5(4), 439–456 (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jaziri, R., Lebbah, M., Bennani, Y., Chenot, JH. (2011). SOS-HMM: Self-Organizing Structure of Hidden Markov Model. In: Honkela, T., Duch, W., Girolami, M., Kaski, S. (eds) Artificial Neural Networks and Machine Learning – ICANN 2011. ICANN 2011. Lecture Notes in Computer Science, vol 6792. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21738-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-21738-8_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21737-1
Online ISBN: 978-3-642-21738-8
eBook Packages: Computer ScienceComputer Science (R0)