Abstract
The paper presents a method for data classification with ensemble of one-class classifiers based on data segmentation. Each data class is partitioned with the nonnegative matrix factorization (NMF) algorithm with sparse constraints. It allows splitting of the input data into compact and consistent data clusters with automatic determination of a number of clusters. Data partitions are fed to an ensemble composed of a number of one-class support vector machine (SVM) classifiers. The proposed method shows high accuracy and fast classification.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)
Bicego, M., Figueiredo, M.A.T.: Soft clustering using weighted one-class support vector machines. Pattern Recognition 42, 27–32 (2009)
Blake, C., Keogh, E., Merz, C.: UCI repository of machine learning databases. University of California, Irvine, Department of Information and Computer Science (http://www.ics.uci.edu/~mlearn/MLRepository.html) (1998)
Brunet, J., Tamayo, P., Golub, T., Mesirov, J.: Metagenes and molecular pattern discovery using matrix factorization. Proceedings of the National Academy of Sciences 101(12), 4164–4169 (2004)
Bucak, S.S., Gunsel, B.: Incremental subspace learning via non-negative matrix factorization. Pattern Recognition 42, 788–797 (2009)
Cichocki, A., Zdunek, R., Amari, S.: Nonnegative Matrix and Tensor Factorization. IEEE Signal Processing Magazine 25(1), 142–145 (2008)
Cichocki, A., Zdunek, R., Phan, A.H., Amari, S-I.: Nonnegative Matrix and Tensor Factorizations. Applications to Exploratory Multi-way Data Analysis and Blind Source Separation. Wiley (2009)
Cyganek, B.: Image segmentation with a hybrid ensemble of one-class support vector machines. In: Graña Romay, M., Corchado, E., Garcia Sebastian, M. (eds.) HAIS 2010, Part I. LNCS, vol. 6076, pp. 254–261. Springer, Heidelberg (2010)
Cyganek, B., Wiatr, K.: Design of parallel architectures of classifiers suitable for intensive data processing. In: The 9th International Conference on Networking and Services, LMPCNA 2013, Lisbon, Portugal, pp. 14–19 (2013)
Cyganek, B.: Object Detection and Recognition in Digital Images, Theory and Practice. Wiley (2013)
Frey, B.J., Dueck, D.: Clustering by passing messages between data points. Science 315, 972–976 (2007)
Horzyk, A.: Self-optimizing neural network 3. In: Franco, L., Elizondo, D.A., Jerez, J.M. (eds.) Constructive Neural Networks. SCI, vol. 258, pp. 83–101. Springer, Heidelberg (2009)
Jackowski, K., Woźniak, M.: Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas. Pattern Analysis and Applications 12, 415–425 (2009)
Kim, J., Park, H.: Sparse Nonnegative Matrix Factorization for Clustering. Georgia Institute of Technology Technical Report GT-CSE-08-01 (2008)
Krawczyk, B., Woźniak, M., Cyganek, B.: Clustering-based ensembles for one-class classification. Information Sciences 264, 182–195 (2014). Elsevier
Kruse, R., Döring, C., Lesot, M-J.: Fundamentals of fuzzy clustering. In: de Oliveira, J.V., Pedrycz, W. (eds.) Advances in Fuzzy Clustering and its Applications, pp. 3–30. Wiley (2007)
Kuncheva, L.I.: Combining Pattern Classifiers. Wiley (2004)
Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401, 788–791 (1999)
Polikar, R.: Ensemble Based Systems in Decision Making. IEEE Circuits and Systems Magazine, 21–45 (2006)
Tax, D., Duin, R.: Support vector domain description. Pattern Recognition Letters 20, 1191–1199 (1999)
Tax, D., Duin, R.: Support Vector Data Description. Machine Learning 54, 45–66 (2004)
University of California, Database (2011). (ftp://ftp.ics.uci.edu/pub/machine-learning-databases/)
Wilk, T., Woźniak, M.: Soft computing methods applied to combination of one-class classifiers. Neurocomputing 75, 185–193 (2012)
Woźniak, M., Graña, M., Corchado, E.: A survey of multiple classifier systems as hybrid systems. Information Fusion 16, 3–17 (2014). Elsevier
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Cyganek, B., Krawczyk, B. (2015). Data Classification with Ensembles of One-Class Support Vector Machines and Sparse Nonnegative Matrix Factorization. In: Nguyen, N., Trawiński, B., Kosala, R. (eds) Intelligent Information and Database Systems. ACIIDS 2015. Lecture Notes in Computer Science(), vol 9011. Springer, Cham. https://doi.org/10.1007/978-3-319-15702-3_51
Download citation
DOI: https://doi.org/10.1007/978-3-319-15702-3_51
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-15701-6
Online ISBN: 978-3-319-15702-3
eBook Packages: Computer ScienceComputer Science (R0)