Abstract
In ensemble-based unsupervised outlier detection, the lack of ground truth makes the combination of basic outlier detectors a challenging task. The existing outlier ensembles usually use certain fusion rules (majority voting, averaging) to aggregate base detectors, which results in relatively low model accuracy and robustness. To overcome this problem, in this research, we propose a robust Multi-stage Ensemble model based on rank aggregation and stacking for Outlier Detection (MEOD). The proposed model uses multiple unsupervised outlier detection algorithms to form a base detector pool. Such a pool can be utilized for extracting useful representations from the train set and integrating base detector results using a ranking aggregation-based approach. To further optimize the proposed model, a stacking-based dynamic classifier selection ensemble model is also proposed, and the best-behaved classifier is adaptively selected as the base learner in the stacking stage on different datasets. Some extensive experiments are also committed to prove that MEOD outperforms the other seven state-of-the-art benchmarks in most cases.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
References
Aggarwal, C.C.: Outlier ensembles: position paper. ACM SIGKDD Explor. Newsl. 14(2), 49–58 (2013)
Aggarwal, C.C., Sathe, S.: Theoretical foundations and algorithms for outlier ensembles. ACM SIGKDD Explor. Newsl. 17(1), 24–47 (2015)
Akoglu, L., Tong, H., Vreeken, J., Faloutsos, C.: Fast and reliable anomaly detection in categorical data. In: Proceedings of the 21st ACM International Conference on Information and Knowledge Management, pp. 415–424 (2012)
Boukerche, A., Zheng, L., Alfandi, O.: Outlier detection: methods, models, and classification. ACM Comput. Surv. (CSUR) 53(3), 1–37 (2020)
Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)
Breunig, M.M., Kriegel, H.P., Ng, R.T., Sander, J.: LOF: identifying density-based local outliers. In: Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, pp. 93–104 (2000)
Chen, T., Guestrin, C.: XGBoost: a scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 785–794 (2016)
Cheng, Y., Xu, Y., Zhong, H., Liu, Y.: HS-TCN: a semi-supervised hierarchical stacking temporal convolutional network for anomaly detection in IoT. In: 2019 IEEE 38th International Performance Computing and Communications Conference (IPCCC), pp. 1–7. IEEE (2019)
Dorogush, A.V., Ershov, V., Gulin, A.: Catboost: gradient boosting with categorical features support. arXiv preprint arXiv:1810.11363 (2018)
Forestier, G., Wemmert, C.: Semi-supervised learning using multiple clusterings with limited labeled data. Inf. Sci. 361, 48–65 (2016)
Freund, Y., Schapire, R.E., et al.: Experiments with a new boosting algorithm. In: ICML, vol. 96, pp. 148–156. Citeseer (1996)
Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 1189–1232 (2001)
Hosmer, D.W., Jr., Lemeshow, S., Sturdivant, R.X.: Applied Logistic Regression, vol. 398. Wiley, Hoboken (2013)
Ke, G., et al.: Lightgbm: a highly efficient gradient boosting decision tree. In: Advances in Neural Information Processing Systems 30 (2017)
Kolde, R., Laur, S., Adler, P., Vilo, J.: Robust rank aggregation for gene list integration and meta-analysis. Bioinformatics 28(4), 573–580 (2012)
Kriegel, H.P., Kröger, P., Schubert, E., Zimek, A.: Loop: local outlier probabilities. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management, pp. 1649–1652 (2009)
Lai, K.H., Zha, D., Xu, J., Zhao, Y., Wang, G., Hu, X.: Revisiting time series outlier detection: definitions and benchmarks. In: Thirty-fifth Conference on Neural Information Processing Systems Datasets and Benchmarks Track (Round 1) (2021)
Li, Y., Song, Y., Jia, L., Gao, S., Li, Q., Qiu, M.: Intelligent fault diagnosis by fusing domain adversarial training and maximum mean discrepancy via ensemble learning. IEEE Trans. Industr. Inf. 17(4), 2833–2841 (2020)
Liu, F.T., Ting, K.M., Zhou, Z.H.: Isolation-based anomaly detection. ACM Trans. Knowl. Discov. Data (TKDD) 6(1), 1–39 (2012)
Ma, J., Perkins, S.: Time-series novelty detection using one-class support vector machines. In: Proceedings of the International Joint Conference on Neural Networks, vol. 3, pp. 1741–1745. IEEE (2003)
Najafi, M., He, L., Philip, S.Y.: Outlier-robust multi-aspect streaming tensor completion and factorization. In: IJCAI, pp. 3187–3194 (2019)
Wan, F., Guo, G., Zhang, C., Guo, Q., Liu, J.: Outlier detection for monitoring data using stacked autoencoder. IEEE Access 7, 173827–173837 (2019)
Wolpert, D.H.: Stacked generalization. Neural Netw. 5(2), 241–259 (1992)
Zhao, Y., Nasrullah, Z., Li, Z.: PyOD: a python toolbox for scalable outlier detection. arXiv preprint arXiv:1901.01588 (2019)
Zhu, J., Li, X., Gao, C., Wang, Z., Kurths, J.: Unsupervised community detection in attributed networks based on mutual information maximization. New J. Phys. 23(11), 113016 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Jiang, Z., Zhang, F., Xu, H., Tao, L., Zhang, Z. (2022). MEOD: A Robust Multi-stage Ensemble Model Based on Rank Aggregation and Stacking for Outlier Detection. In: Memmi, G., Yang, B., Kong, L., Zhang, T., Qiu, M. (eds) Knowledge Science, Engineering and Management. KSEM 2022. Lecture Notes in Computer Science(), vol 13370. Springer, Cham. https://doi.org/10.1007/978-3-031-10989-8_17
Download citation
DOI: https://doi.org/10.1007/978-3-031-10989-8_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-10988-1
Online ISBN: 978-3-031-10989-8
eBook Packages: Computer ScienceComputer Science (R0)