Abstract
In our previous work we presented a variation of Self-Organizing Map (SOM), CSOM that applies a different learning mechanism useful for situations where the aim is to extract rules from a data set characterized by continuous input features. The main change is that the weights on the network links are replaced by ranges which allows for a direct extraction of the underlying rule. In this paper we extend our work by allowing the CSOM to handle mixed data types and continuous class attributes. These extensions called for an appropriate adjustment in the network pruning method that uses the Symmetrical Tau (τ) criterion for measuring the predictive capability of cluster attributes. Publicly available real world data sets were used for evaluating the proposed method and the results demonstrate the effectiveness of the method as a whole for extracting optimal rules from a trained SOM.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bloomer, W.F., Dillon, T.S., Witten, M.: Hybrid Brainne: A Method for Developing Symbolic Rules from a Hybrid Neural Network. In: IEEE International Conference on Systems Man and Cybernetics, Beijing, China, pp. 14–17 (1996)
Dillon, T.S., Sestito, S., Witten, M., Suing, M.: Automated Knowledge Acquisition Using Unsupervised Learning. In: Proceedings of the Second IEEE Workshop on Engineering Technology and Factory Automation (EFTA ’93), Cairns, pp. 119–128 (1993)
Gupta, A., Park, S., Lam, S.M.: Generalized Analytic Rule Extraction for Feedforward Neural Networks. IEEE Transactions on Knowledge and Data Engineering 11, 985–991 (1998)
Hammer, B., Rechtien, A., Strickert, M., Villmann, T.: Rule Extraction from Self-Organizing Networks. In: Dorronsoro, J.R. (ed.) ICANN 2002. LNCS, vol. 2415, p. 877. Springer, Heidelberg (2002)
McGarry, K.J., Wermter, S., MacIntyre, J.: Knowledge Extraction from Radial Basis Function Networks and Multi-layer Perceptrons. In: International Joint Conference on Neural Networks, Washington D.C. (1999)
Setiono, R., Leow, W.K., Zurada, J.M.: Extraction of Rules from Artificial Neural Networks for Linear Regression. IEEE Transactions on Neural Networks 13(3), 564–577 (2002)
Taha, I.A., Ghosh, J.: Symbolic Interpretation of Artificial Neural Networks. IEEE Transactions on Knowledge and Data Engineering 11, 448–462 (1998)
Kohonen, T.: The Self-Organizing Map. Proceedings of the IEEE 78(9), 1464–1480 (1990)
Kaski, S., Nikkilä, J., Kohonen, T.: Methods for Interpreting a Self-Organized Map in Data Analysis. In: Verleysen, M. (ed.) Proceedings of ESANN’98, 6th European Symposium on Artificial Neural Networks, Bruges, pp. 185–190. D-Facto, Brussels (1998)
Rauber, A., Merkl, D.: Automatic labeling of self-organizing maps: Making a treasure-map reveal its secrets. In: Zhong, N., Zhou, L. (eds.) PAKDD 1999. LNCS (LNAI), vol. 1574, pp. 228–237. Springer, Heidelberg (1999)
Siponen, M., Vesanto, J., Simula, O., Vasara, P.: An Approach to Automated Interpretation of SOM. In: Advances in Self-Organizing Maps, pp. 89–94. Springer, Heidelberg (2001)
Ultsch, A.: Knowledge Extraction from Self-Organizing Neural Networks. In: Opitz, O., Lausen, B., Klar, R. (eds.) Information and Classification, pp. 301–306. Springer, Berlin (1993)
Sestito, S., Dillon, S.T.: Automated Knowledge Acquisition. Prentice Hall of Australia Pty Ltd., Sydney (1994)
Hadzic, F., Dillon, T.S.: CSOM: Self Organizing Map for Continuous Data. In: 3rd International IEEE Conference on Industrial Informatics, Perth (2005)
Zhou, X., Dillon, T.S.: A Statistical-Heuristic Feature Selection Criterion for Decision Tree Induction. IEEE Transactions on Pattern Analysis and Machine Intelligence 13(8), 834–841 (1991)
Wang, D., Dillon, T.S., Chang, E.: Trading off between Misclassification, Recognition and Generalization in Data Mining with Continuous Features. In: Hendtlass, T., Ali, M. (eds.) IEA/AIE 2002. LNCS (LNAI), vol. 2358, pp. 303–313. Springer, Heidelberg (2002)
Abe, S., Sakaguchi, K.: Generalization Improvement of a Fuzzy Classifier with Ellipsoidal Regions. In: Proc. of the 10th IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2001), Melbourne, pp. 207–210 (2001)
Chen, Z.: Data Mining and Uncertain Reasoning: An Integrated Approach. John Wiley & Sons, Inc., New York (2001)
Engelbrecht, A.P.: Computational Intelligence: An Introduction. J. Wiley & Sons, Hoboken (2002)
Lecun, Y., Denker, J., Solla, S.: Optimal Brain Damage. In: Touretzky, D.S. (ed.) Advances in Neural Information Processing Systems, vol. 2, pp. 598–605. Morgan Kauffman, San Francisco (1990)
Goh, T.H.: Semantic Extraction Using Neural Network Modeling and Sensitivity Analysis. In: Proceedings of the 1993 International Joint Conference on Neural Networks, pp. 1031–1034 (1993)
Tsaih, R.: Sensitivity Analysis, Neural Networks, and the Finance. In: IEEE International Joint Conference on Neural Networks, vol. 6, pp. 3830–3835 (1999)
Bruner, S., Goodnow, J.J., Austin, G.A.: A Study of Thinking. John Wiley & Sons, Inc., New York (1956)
Blake, C., Keogh, E., Merz, C.J.: UCI Repository of Machine Learning Databases. University of California, Department of Information and Computer Science, Irvine, CA (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Quinlan, J.R.: Simplifying Decision Trees. International Journal of Man-Machine Studies 27, 221–234 (1987)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Hadzic, F., Dillon, T.S. (2007). CSOM for Mixed Data Types. In: Liu, D., Fei, S., Hou, Z., Zhang, H., Sun, C. (eds) Advances in Neural Networks – ISNN 2007. ISNN 2007. Lecture Notes in Computer Science, vol 4492. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72393-6_115
Download citation
DOI: https://doi.org/10.1007/978-3-540-72393-6_115
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72392-9
Online ISBN: 978-3-540-72393-6
eBook Packages: Computer ScienceComputer Science (R0)