QML-AiNet: An immune network approach to learning qualitative differential equation models

In this paper, we explore the application of Opt-AiNet, an immune network approach for search and optimisation problems, to learning qualitative models in the form of qualitative differential equations. The Opt-AiNet algorithm is adapted to qualitative model learning problems, resulting in the proposed system QML-AiNet. The potential of QML-AiNet to address the scalability and multimodal search space issues of qualitative model learning has been investigated. More importantly, to further improve the efficiency of QML-AiNet, we also modify the mutation operator according to the features of discrete qualitative model space. Experimental results show that the performance of QML-AiNet is comparable to QML-CLONALG, a QML system using the clonal selection algorithm (CLONALG). More importantly, QML-AiNet with the modified mutation operator can significantly improve the scalability of QML and is much more efficient than QML-CLONALG.

[1]  Ashwin Srinivasan,et al.  Qualitative System Identification from Imperfect Data , 2008, J. Artif. Intell. Res..

[2]  Benjamin Kuipers,et al.  Automatic Abduction of Qualitative Models , 1992, AAAI.

[3]  W. Ritschel,et al.  Handbook of basic pharmacokinetics-- including clinical applications , 1992 .

[4]  Wei Pang,et al.  Modified clonal selection algorithm for learning qualitative compartmental models of metabolic systems , 2007, GECCO '07.

[5]  Philip Sedgwick,et al.  Parametric v non-parametric statistical tests , 2012, BMJ : British Medical Journal.

[6]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[7]  Kenneth D. Forbus.  The qualitative process engine , 1989 .

[8]  Benjamin J. Kaipers,et al.  Qualitative Simulation , 1989, Artif. Intell..

[9]  Wei Pang.  QML-Morven : a framework for learning qualitative models , 2009 .

[10]  George Macleod Coghill.  Mycroft : a framework for constraint based fuzzy qualitative reasoning , 1996 .

[11]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[12]  Allan M. Bruce.  JMorven : a framework for parallel non-constructive qualitative reasoning and fuzzy interval simulation , 2007 .

[13]  Benjamin Kuipers,et al.  Qualitative Simulation , 1986, Artificial Intelligence.

[14]  Wei Pang,et al.  Learning Qualitative Metabolic Models Using Evolutionary Methods , 2010, 2010 Fifth International Conference on Frontier of Computer Science and Technology.

[15]  Jonathan Timmis,et al.  A Comment on Opt-AiNET: An Immune Network Algorithm for Optimisation , 2004, GECCO.

[16]  N. G. Parke,et al.  Ordinary Differential Equations. , 1958 .

[17]  L.N. de Castro,et al.  An artificial immune network for multimodal function optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[18]  Wei Pang,et al.  QML-Morven: A Novel Framework for Learning Qualitative Models , 2012 .

[19]  Alen Varsek,et al.  Qualitative Model Evolution , 1991, IJCAI.

[20]  Herbert A. Simon,et al.  Causality and Model Abstraction , 1994, Artif. Intell..

[21]  Ivan Bratko,et al.  Learning Qualitative Models of Dynamic Systems , 1994, ML.

[22]  Fernando José Von Zuben,et al.  Learning and optimization using the clonal selection principle , 2002, IEEE Trans. Evol. Comput..

[23]  Ivan Bratko,et al.  Learning Qualitative Models , 2004, AI Mag..

[24]  W. Ritschel,et al.  Handbook of Basic Pharmacokinetics … Including Clinical Applications, Seventh Edition , 2009 .

[25]  Ivan Bratko,et al.  Induction of Qualitative Trees , 2001, ECML.

[26]  S. Ellner,et al.  Dynamic Models in Biology , 2006 .

[27]  Qiang Shen,et al.  Fuzzy qualitative simulation , 1993, IEEE Trans. Syst. Man Cybern..

[28]  Stephen Muggleton,et al.  Efficient Induction of Logic Programs , 1990, ALT.

[29]  Enrico W. Coiera.  Learning Qualitative Models From Example Behaviours , 2004 .

[30]  Benjamin Kuipers,et al.  Qualitative reasoning: Modeling and simulation with incomplete knowledge , 1994, Autom..

[31]  Kenneth D. Forbus,et al.  Learning Qualitative Models by Demonstration , 2012, AAAI.

[32]  George M. Coghill,et al.  Parallel Fuzzy Qualitative Reasoning , 2005 .

[33]  Selahattin Kuru,et al.  Qualitative System Identification: Deriving Structure from Behavior , 1996, Artif. Intell..

[34]  Fabrício Olivetti de França,et al.  On the diversity mechanisms of opt-aiNet: A comparative study with fitness sharing , 2010, IEEE Congress on Evolutionary Computation.

[35]  A. Stuart,et al.  Non-Parametric Statistics for the Behavioral Sciences. , 1957 .

[36]  Wei Pang,et al.  QML-AiNet: An Immune-Inspired Network Approach to Qualitative Model Learning , 2010, ICARIS.

[37]  Ivan Bratko,et al.  Learning qualitative models from numerical data , 2011, Artif. Intell..

[38]  Sowmya Ramachandran and Raymond J. Mooney and Benjamin J. Kuipers.  Learning Qualitative Models for Systems with Multiple Operating Regions , 1994 .

[39]  Gregory W. Corder,et al.  Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach , 2009 .

[40]  Peter Struss,et al.  Qualitative futures , 2006, The Knowledge Engineering Review.

[41]  Rui Camacho,et al.  Inducing Models of human Control Skills , 1998, ECML.

[42]  Wei Pang,et al.  Learning Qualitative Differential Equation models: a survey of algorithms and applications , 2010, The Knowledge Engineering Review.

[43]  J. O. Irwin,et al.  MATHEMATICAL EPIDEMIOLOGY , 1958 .

[44]  Rui Carlos Camacho de Sousa Ferreira da Silva,et al.  Inducing models of human control skills using machine learning algorithms , 2000 .

[45]  D. Fields,et al.  Body composition techniques and the four-compartment model in children. , 2000, Journal of applied physiology.

[46]  Kenneth D. Forbus.  Qualitative Process Theory , 1984, Artif. Intell..

[47]  A. W. Kelman,et al.  Compartmental models and their application , 1985 .

[48]  Wei Pang,et al.  Evolutionary approaches for learning qualitative compartment metabolic models , 2006 .

[49]  Leandro Nunes de Castro,et al.  The Clonal Selection Algorithm with Engineering Applications 1 , 2000 .