Avoiding Order Effects in Incremental Learning

This paper addresses the problem of mitigating the order effects in incremental learning, a phenomenon observed when different ordered sequences of observations lead to different results. A modification of an ILP incremental learning system, with the aim of making it order-independent, is presented. A backtracking strategy on theories is incorporated in its refinement operators, which causes a change of its refinement strategy and reflects the human behavior during the learning process. A modality to restore a previous theory, in order to backtrack on a previous knowledge level, is presented. Experiments validate the approach in terms of computational cost and predictive accuracy.

[1]  Hans Spada,et al.  Learning in Humans and Machines: Towards an Interdisciplinary Learning Science , 1995 .

[2]  Stefano Ferilli,et al.  A Backtracking Strategy for Order-Independent Incremental Learning , 2004, ECAI.

[3]  Nicola Fanizzi,et al.  Incremental multistrategy learning for document processing , 2003, Appl. Artif. Intell..

[4]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[5]  Shan-Hwei Nienhuys-Cheng,et al.  Foundations of Inductive Logic Programming , 1997, Lecture Notes in Computer Science.

[6]  Paul E. Utgoff,et al.  Incremental Induction of Decision Trees , 1989, Machine Learning.

[7]  Donato Malerba,et al.  Locally Finite, Proper and Complete Operators for Refining Datalog Programs , 1996, ISMIS.

[8]  Antoine Cornuéjols,et al.  Getting Order Independence in Incremental Learning , 1993, ECML.

[9]  Céline Rouveirol,et al.  Machine Learning: ECML-98 , 1998, Lecture Notes in Computer Science.

[10]  Ryszard S. Michalski.  Knowledge Repair Mechanisms: Evolution vs Revolution , 1985 .

[11]  Douglas H. Fisher,et al.  Knowledge Acquisition Via Incremental Conceptual Clustering , 1987, Machine Learning.

[12]  Josep Roure Alcobé,et al.  A Buffering Strategy to Avoid Ordering Effects in Clustering , 1998, ECML.

[13]  Nicola Fanizzi,et al.  Conceptual Change in Learning Naive Physics: The Computational Model as a Theory Revision Process , 1999, AI*IA.

[14]  Douglas H. Fisher,et al.  Ordering Effects in Incremental Learning , 1993 .

[15]  Donato Malerba,et al.  A Logic Framework for the Incremental Inductive Synthesis of Datalog Theories , 1997, LOPSTR.

[16]  Ephraim Nissan.  Peter Reimann and Hans Spada (eds), Learning in Humans and Machines: Towards an Interdisciplinary Learning Science , 1997 .

[17]  Alan Bundy,et al.  Logic Program Synthesis via Proof Planning , 1992, LOPSTR.