Abstract
The GANNFL Approach uses a steady state Genetic Algorithm (GA) to build and train hybrid classifiers which are combinations of Neural Networks (NN's) and Fuzzy Logic (FL). This novel approach finds both the architecture, the types of the hidden units, the types of the output units, and all weights ! The designed modular and tight GA encoding together with the GA fitness function lets the GA develop high performance hybrid classifiers, which consist of NN parts and FL parts co-operating tightly within the same architecture. By analysing the behaviour of the GA it will be investigated whether there is evidence for preferring NN classifiers or FL classifiers. Further, the importance of the types of the hidden units is investigated. Parameter reduction is a very important issue according to the theory of the VC-dimension and Ockham's Razor. Hence, the GANNFL Approach also focuses on parameter reduction, which is achieved by automatically pruning unnecessary weights and units. The GANNFL Approach was tested on 5 well known classification problems: The artificial, noisy monks3 problem and 4 problems representing difficult real-world problems that contain missing, noisy, misclassified, and few data: The cancer, card, diabetes and glass problems. The results are compared to public available results found by other NN approaches, the sGANN approach (simple GA to train NN's), and the ssGAFL approach (steady state GA to train FL classifiers). In every case the GANNFL Approach found a better or comparable result than the best other approach!
Preview
Unable to display preview. Download preview PDF.
References
L. Prechelt, “Proben1 — A Set of Neural Network Benchmark Problems and Benchmarking Rules”, TR 21/94 (1994), anonymous ftp: /pub/papers/techreports/1994/1994-19.ps.Z on ftp.ira.uka.de.
Martin Schmidt and Thomas Stidsen, “Using GA to train NN using sharing and pruning”, SCAI'95, anon. ftp: pub/empl/marsch/SCAI95.ps.Z on ftp.daimi.aau.dk
Martin Schmidt and Thomas Stidsen, “GA to train NN's using sharing and pruning: Global GA search combined with local BP search”, ADT'95, anon. ftp: pub/empl/marsch/ADT95.ps.Z on ftp.daimi.aau.dk, also in John Wiley's book “Neural Networks and their Applications” (chapter 8).
Martin Schmidt, “Genetic Algorithm to train Fuzzy Logic Rulebases and Neural Networks”, FLAMOC'96, anon. ftp: pub/empl/marsch/FLAMOC96.ps.Z on ftp.daimi.aau.dk
Wnek, Sarma, Wahab and Michalski, “Comparison learning paradigms via diagrammatic Visualization”, TR (1990), George Mason University
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1996 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schmidt, M. (1996). A unification of Genetic Algorithms, Neural Networks and Fuzzy Logic: The GANNFL Approach. In: von der Malsburg, C., von Seelen, W., Vorbrüggen, J.C., Sendhoff, B. (eds) Artificial Neural Networks — ICANN 96. ICANN 1996. Lecture Notes in Computer Science, vol 1112. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-61510-5_85
Download citation
DOI: https://doi.org/10.1007/3-540-61510-5_85
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-61510-1
Online ISBN: 978-3-540-68684-2
eBook Packages: Springer Book Archive