Agent-Based Approach to Distributed Ensemble Learning of Fuzzy ARTMAP Classifiers

Abstract

This paper presents a parallel and distributed approach to ensemble learning of Fuzzy ARTMAP classifiers based on the multi-agent platform. Neural networks have been used successfully in a broad range of non-linear problems that are difficult to solve using traditional techniques. Training a neural network for practical applications is often time consuming thus extensive research work is being carried out to accelerate this process. Fuzzy ARTMAP (FAM) is one of the fastest neural network architectures given its ability to produce neurons on demand to represent new classification categories. FAM can adapt to the input data without having to specify an arbitrary structure. However, FAM is vulnerable to noisy data which can rapidly degrade network performance. Due to its fast learning features, FAM is sensitive to the sequence of input sample presentations. In this paper we propose a parallel and distributed approach to ensemble learning for FAM networks as a means to improve the over-all performance of the classifier and increase its resilience to noisy data. We use the multi-agent platform to distribute the computational load of the ensemble to several hosts. The multi-agent platform is a robust environment that can support large-scale neural network ensembles. Our approach also demonstrates the feasibility of large-scale ensembles. The experimental results show that ensemble learning substantially improved the performance of fuzzy ARTMAP classifiers.

This research was supported by the Program for the Training of Graduate Students in Regional Innovation which was conducted by the Ministry of Commerce Industry and Energy of the Korean Government.