Learning qualitative models from numerical data

Qualitative models describe relations between the observed quantities in qualitative terms. In predictive modelling, a qualitative model tells whether the output increases or decreases with the input. We describe Pade, a new method for qualitative learning which estimates partial derivatives of the target function from training data and uses them to induce qualitative models of the target function. We formulated three methods for computation of derivatives, all based on using linear regression on local neighbourhoods. The methods were empirically tested on artificial and real-world data. We also provide a case study which shows how the developed methods can be used in practice.

[1]  P. Samuelson,et al.  Foundations of Economic Analysis. , 1948 .

[2]  Kenneth D. Forbus Qualitative Process Theory , 1984, Artif. Intell..

[3]  Luc De Raedt,et al.  Proceedings of the 12th European Conference on Machine Learning , 2001 .

[4]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[5]  John B. Kidd,et al.  Models of Discovery , 1978 .

[6]  Ivan Bratko,et al.  Qualitatively Faithful Quantitative Prediction , 2003, IJCAI.

[7]  Shai Ben-David,et al.  A Sober Look at Clustering Stability , 2006, COLT.

[8]  Enrico W. Coiera Learning Qualitative Models From Example Behaviours , 2004 .

[9]  Herbert A. Simon,et al.  The mathematical bases for qualitative reasoning , 1991, IEEE Expert.

[10]  Ivan Bratko,et al.  Learning Qualitative Models of Dynamic Systems , 1994, ML.

[11]  Herbert A. Simon,et al.  Aggregation of Variables in Dynamic Systems , 1961 .

[12]  Ashwin Srinivasan,et al.  Qualitative System Identification from Imperfect Data , 2008, J. Artif. Intell. Res..

[13]  Benjamin Kuipers,et al.  Automatic Abduction of Qualitative Models , 1992, AAAI.

[14]  Saso Dzeroski,et al.  Discovering dynamics: From inductive logic programming to machine discovery , 1993, Journal of Intelligent Information Systems.

[15]  Ivan Bratko,et al.  Learning Qualitative Models , 2004, AI Mag..

[16]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[17]  Johan de Kleer,et al.  A Qualitative Physics Based on Confluences , 1984, Artif. Intell..

[18]  Herbert A. Simon,et al.  DIRECTIONS FOR QUALITATIVE REASONING , 1992, Comput. Intell..

[19]  Ljupčo Todorovski,et al.  Using domain knowledge for automated modelling of dynamic systems with equation discovery , 2003 .

[20]  C. Jeffries Qualitative Stability and Digraphs in Model Ecosystems , 1974 .

[21]  Igor Mozetic Learning of Qualitative Models , 1987, EWSL.

[22]  Blaz Zupan,et al.  Orange: From Experimental Machine Learning to Interactive Data Mining , 2004, PKDD.

[23]  Benjamin J. Kaipers,et al.  Qualitative Simulation , 1989, Artif. Intell..

[24]  Wei Pang,et al.  An immune-inspired approach to qualitative system identification of biological pathways , 2011, Natural Computing.

[25]  Ashwin Srinivasan,et al.  Discovering the Structure of Partial Differential Equations from Example Behaviour , 2000, ICML.

[26]  Bernhard Rinner,et al.  Semi-quantitative system identification , 2000, Artif. Intell..

[27]  Ivan Bratko,et al.  Induction of Qualitative Trees , 2001, ECML.

[28]  Reha Kamil Gerceker USING POLYNOMIAL APPROXIMATIONS TO DISCOVER QUALITATIVE MODELS , 2006 .

[29]  Jayant R. Kalagnanam Qualitative analysis of system behaviour , 1992 .

[30]  Ivan Bratko,et al.  KARDIO - a study in deep and qualitative knowledge for expert systems , 1989 .

[31]  H. Simon,et al.  On the Definition of the Causal Relation , 1952 .

[32]  Dorian Suc,et al.  Machine Reconstruction of Human Control Strategies , 2003, Frontiers in Artificial Intelligence and Applications.

[33]  Sowmya Ramachandran and Raymond J. Mooney and Benjamin J. Kuipers Learning Qualitative Models for Systems with Multiple Operating Regions , 1994 .

[34]  Selahattin Kuru,et al.  Qualitative System Identification: Deriving Structure from Behavior , 1996, Artif. Intell..

[35]  Theo Tryfonas,et al.  Frontiers in Artificial Intelligence and Applications , 2009 .

[36]  Benjamin Kuipers,et al.  Qualitative Simulation , 1986, Artificial Intelligence.

[37]  Igor Mozetič THE ROLE OF ABSTRACTIONS IN LEARNING QUALITATIVE MODELS , 1987 .

[38]  Alen Varsek,et al.  Qualitative Model Evolution , 1991, IJCAI.

[39]  R. May Qualitative Stability in Model Ecosystems , 1973 .

[40]  Sago Deroski,et al.  Discovering Dynamics: From Inductive Logic Programming To Machine Discovery , 2002 .

[41]  Saso Dzeroski,et al.  Discovering Dynamics , 1993, ICML.

[42]  Robert King,et al.  Learning Qualitative Models in the Presence of Noise , 2002 .