Abstract
In this paper, we propose a new ensemble for an effective segmentation of hyperspectral images. It uses one-class classifiers as base learners. We prove, that despite the multi-class nature of hyperspectral images using one-class approach can be beneficial. One need simply to decompose a multi-class set into a number of simpler one-class tasks. One-class classifiers can handle difficulties embedded in the nature of the hyperspectral data, such as a large number of classes, class imbalance and noisy pixels. For this task, we utilise our novel ensemble, based on soft clustering of the object space. On the basis of each cluster, a weighted one-class classifier is constructed. We show a fast method for calculating weights assigned to each object, and for an automatic calculation of preferred number of clusters. We propose to build such ensemble for each of the classes and then to reconstruct the original multi-class hyperspectral image using Error-Correcting Output Codes. Experimental analysis, carried on a set of benchmark data and backed-up with an extensive statistical analysis, proves that our one-class ensemble is an efficient tool for handling hyperspectral images and outperforms several state-of-the-art binary and multi-class classifiers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alpaydin, E.: Combined 5 x 2 cv f test for comparing supervised classification learning algorithms. Neural Computation 11(8), 1885–1892 (1999)
Bezdek, J.: Pattern Recognition With Fuzzy Objective Function Algorithms. Plenum Press, New York (1981)
Bicego, M., Figueiredo, M.A.T.: Soft clustering using weighted one-class support vector machines. Pattern Recognition 42(1), 27–32 (2009)
Breiman, L.: Random forests. Machine Learning 45(1), 5–32 (2001)
Cyganek, B.: One-class support vector ensembles for image segmentation and classification. Journal of Mathematical Imaging and Vision 42(2-3), 103–117 (2012)
Demsar, J.: Statistical comparisons of classifiers over multiple data sets. Journal of Machine Learning Research 7, 1–30 (2006)
Fauvel, M., Chanussot, J., Benediktsson, J.A.: A spatial-spectral kernel-based approach for the classification of remote-sensing images. Pattern Recognition 45(1), 381–392 (2012)
Galar, M., Fernandez, A., Barrenechea, E., Bustince, H., Herrera, F.: An overview of ensemble methods for binary classifiers in multi-class problems: Experimental study on one-vs-one and one-vs-all schemes. Pattern Recognition 44(8), 1761–1776 (2011)
Juszczak, P.: Learning to recognise. A study on one-class classification and active learning. PhD thesis, Delft University of Technology (2006)
Koch, M.W., Moya, M.M., Hostetler, L.D., Fogler, R.J.: Cueing, feature discovery, and one-class learning for synthetic aperture radar automatic target recognition. Neural Networks 8(7-8), 1081–1102 (1995)
Krawczyk, B., Woźniak, M.: Combining diverse one-class classifiers. In: Corchado, E., Snášel, V., Abraham, A., Woźniak, M., Graña, M., Cho, S.-B. (eds.) HAIS 2012, Part II. LNCS, vol. 7209, pp. 590–601. Springer, Heidelberg (2012)
Krawczyk, B., Woźniak, M.: Diversity measures for one-class classifier ensembles. Neurocomputing 126, 36–44 (2014)
Krawczyk, B., Woźniak, M., Cyganek, B.: Clustering-based ensembles for one-class classification. Information Sciences 264, 182–195 (2014)
Kuncheva, L.I.: Clustering-and-selection model for classifier combination. In: KES, pp. 185–188 (2000)
Li, C.-H., Kuo, B.-C., Lin, C.-T., Huang, C.-S.: A spatial-contextual support vector machine for remotely sensed image classification. IEEE Transactions on Geoscience and Remote Sensing 50(3), 784–799 (2012)
Li, J., Bioucas-Dias, J.M., Plaza, A.: Spectral-spatial hyperspectral image segmentation using subspace multinomial logistic regression and markov random fields. IEEE Transactions on Geoscience and Remote Sensing 50(3), 809–823 (2012)
Li, K., Huang, H., Tian, S.: A novel multi-class svm classifier based on ddag. In: Proceedings of 2002 International Conference on Machine Learning and Cybernetics, vol. 3, pp. 1203–1207 (2002)
Richards, J.A., Jia, X.: Remote Sensing Digital Image Analysis. An Introduction. Springer, Heidelberg (1999)
Shen, L., Jia, S.: Three-dimensional gabor wavelets for pixel-based hyperspectral imagery classification. IEEE Transactions on Geoscience and Remote Sensing 49(12), 5039–5046 (2011)
Tarabalka, Y., Chanussot, J., Benediktsson, J.A.: Segmentation and classification of hyperspectral images using watershed transformation. Pattern Recognition 43(7), 2367–2379 (2010)
Tax, D.M.J., Duin, R.P.W.: Support vector data description. Machine Learning 54(1), 45–66 (2004)
Tax, D.M.J.: Robert P. W. Duin. Characterizing one-class datasets. In: Proceedings of the Sixteenth Annual Symposium of the Pattern Recognition Association of South Africa, pp. 21–26 (2005)
Wilk, T., Woźniak, M.: Soft computing methods applied to combination of one-class classifiers. Neurocomput. 75, 185–193 (2012)
Zhang, L., Zhou, W., Jiao, L.: Kernel clustering algorithm. Jisuanji Xuebao/Chinese Journal of Computers 25(6), 587–590 (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Krawczyk, B., Woźniak, M., Cyganek, B. (2014). Clustering-Based Ensemble of One-Class Classifiers for Hyperspectral Image Segmentation. In: Polycarpou, M., de Carvalho, A.C.P.L.F., Pan, JS., Woźniak, M., Quintian, H., Corchado, E. (eds) Hybrid Artificial Intelligence Systems. HAIS 2014. Lecture Notes in Computer Science(), vol 8480. Springer, Cham. https://doi.org/10.1007/978-3-319-07617-1_59
Download citation
DOI: https://doi.org/10.1007/978-3-319-07617-1_59
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07616-4
Online ISBN: 978-3-319-07617-1
eBook Packages: Computer ScienceComputer Science (R0)