Abstract
Inductive Logic Programming (ILP) involves constructing an hypothesis H on the basis of background knowledge B and training examples E. An independent test set is used to evaluate the accuracy of H. This paper concerns an alternative approach called Analogical Prediction (AP). AP takes B, E and then for each test example ???x, y??? forms an hypothesis H x from B, E, x. Evaluation of AP is based on estimating the probability that Hx(x) = y for a randomly chosen ???x, y???. AP has been implemented within CProgol4.4. Experiments in the paper show that on English past tense data AP has significantly higher predictive accuracy on this data than both previously reported results and CProgol in inductive mode. However, on KRK illegal AP does not outperform CProgol in inductive mode. We conjecture that AP has advantages for domains in which a large proportion of the examples must be treated as exceptions with respect to the hypothesis vocabulary. The relationship of AP to analogy and instance-based learning is discussed. Limitations of the given implementation of AP are discussed and improvements suggested.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
J. Arima. Logical Foundations of Induction and Analogy. PhD thesis, Kyoto University, 1998.
T. Davies and S.J. Russell. A logical approach to reasoning by analogy. In IJCAI-87, pages 264–270. Morgan Kaufmann, 1987.
W. Emde and D. Wettschereck. Relational Instance-Based Learning. In L. Saitta, editor, Proceedings of the 13th International Machine Learning Conference, pages 122–130, Los Altos, 1996. Morgan Kaufmann.
T.G. Evans. A program for the solution of a class of geoemtric analogy intellgence test questions. In M. Minsky, editor, Semantic Information Processing. MIT Press, Cambridge, MA, 1968.
A. Hutchinson. Metrics on terms and clauses. In M. Someren and G. Widmer, editors, Proceedings of the Ninth European Conference on Machine Learning, pages 138–145, Berlin, 1997. Springer.
C.X. Ling. Learning the past tense of english verbs: the symbolic pattern associators vs. connectionist models. Journal of Artificial Intelligence Research, 1:209–229, 1994.
R.J. Mooney and M.E. Califf. Induction of first-order decision lists: Results on learning the past tense of english verbs. Journal of Artificial Intelligence Research, 3:1–24, 1995.
S. Muggleton. Inverse entailment and Progol. New Generation Computing, 13:245–286, 1995.
S. Muggleton, M.E. Bain, J. Hayes-Michie, and D. Michie. An experimental comparison of human and machine learning formalisms. In Proceedings of the Sixth International Workshop on Machine Learning, Los Altos, CA, 1989. Kaufmann.
S. Muggleton and L. De Raedt. Inductive logic programming: Theory and methods. Journal of Logic Programming, 19,20:629–679, 1994.
S.H. Nienhuys-Cheng. Distance between Herbrand interpretations: a measure for approximations to a target concept. In N. Lavrač and S. Džeroski, editors, Proceedings of the Seventh International Workshop on Inductive Logic Programming (ILP97), pages 321–226, Berlin, 1997. Springer-Verlag. LNAI 1297.
S.H. Nienhuys-Cheng. Distances and limits on Herbrand interpretations. In C.D. Page, editor, Proceedings of the Eighth International Conference on Inductive Logic Programming (ILP98), pages 250–260, Berlin, 1998. Springer. LNAI 1446.
C.S. Peirce. Elements of logic. In C. Hartshorne and P. Weiss, editors, Collected Papers of Charles Sanders Peirce, volume 2. Harvard University Press, Cambridge, MA, 1932.
G. Polya. Induction and analogy in mathematics. In Mathematics and Plausible Reasoning, volume 1. Princeton University Press, Princeton, 1954.
D.E. Rumelhart and J.L. McClelland. On learning the past tense of english verbs. In Explorations in the Micro-Structure of Cognition Vol. II, pages 216–271. MIT Press, Cambridge, MA, 1986.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Muggleton, S., Bain, M. (1999). Analogical Prediction. In: Džeroski, S., Flach, P. (eds) Inductive Logic Programming. ILP 1999. Lecture Notes in Computer Science(), vol 1634. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48751-4_22
Download citation
DOI: https://doi.org/10.1007/3-540-48751-4_22
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-66109-2
Online ISBN: 978-3-540-48751-7
eBook Packages: Springer Book Archive