Abstract
In the paper the algorithm of the ‘naive’ Bayesian classifier (that assumes the independence of attributes) is extended to detect the dependencies between attributes. The idea is to optimize the tradeoff between the ‘non-naivety’ and the reliability of approximations of probabilities. Experiments in four medical diagnostic problems are described. In two domains where by the experts opinion the attributes are in fact independent the semi- naive Bayesian classifier achieved the same classification accuracy as naive Bayes. In two other domains the semi-naive Bayesian classifier slightly outperformed the naive Bayesian classifier.
Chapter PDF
References
Cestnik B. (1990) Estimating Probabilities: A Crucial Task in Machine Learning, Proc. European Conference on Artificial Intelligence 90, Stockholm, August 1990.
Cestnik, B., Kononenko, I., Bratko, I. (1987) ASSISTANT 86: A Knowledge Elicitation Tool for Sophisticated Users. In: I. Bratko, N. Lavrač (eds.), Progress in Machine learning. Wilmslow, England: Sigma Press.
Good I.J. (1950) Probability and the weighing of evidence. London: Charles Griffin.
Kononenko, I. (1989) ID3, sequential Bayes, naive Bayes and Bayesian neural networks. Proc. 4th European Working Session on Learning, Montpellier, France, December 1989, pp.91–98.
Kononenko, I. (1990) Comparison of inductive and naive Bayesian learning approaches to automatic knowledge acquisition. In: B. Wielinga et al. (eds.) Current Trends in Knowledge Acquisition, Amsterdam: IOS Press.
Kononenko, I. & Bratko, I. (1991) Information Based Evaluation Criterion for Classifier's Performance. Machine Learning, Vol.6, pp.67–80 (in press).
Pirnat V., Kononenko I., Janc T., Bratko I. (1989) Medical Estimation of Automatically Induced Decision Rules, Proc. of 2nd Europ. Conf. on Artificial Intelligence in Medicine, City University, London, August 29–31 1989, pp.24–36.
Smyth P. & Goodman R.M. (1990) Rule Induction Using Information Theory. In: G.Piarersky & W.Frawley (eds.) Knowledge Discovery in Databases, MIT Press.
Vadnal A. (1979) Elementary Introduction to Probability Calculus (in Slovene), Državna založba Slovenije, Ljubljana.
Van de Velde (1989) IDL, or Taming the Multiplexer, Proc. 4th European Working Session on Learning, Montpellier, France, December 1989, pp.211–225.
Wan S.J. & Wong S.K.M. (1989) A Measure for Concept Dissimilarity and its Applications in Machine Learning, Proc. Int. Conf. on Computing and Information, Toronto North, Canada, May 23–27 1989.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1991 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Kononenko, I. (1991). Semi-naive bayesian classifier. In: Kodratoff, Y. (eds) Machine Learning — EWSL-91. EWSL 1991. Lecture Notes in Computer Science, vol 482. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0017015
Download citation
DOI: https://doi.org/10.1007/BFb0017015
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-53816-5
Online ISBN: 978-3-540-46308-5
eBook Packages: Springer Book Archive