An Integrated Qualitative and Quantitative Biochemical Model Learning Framework Using Evolutionary Strategy and Simulated Annealing

Both qualitative and quantitative model learning frameworks for biochemical systems have been studied in computational systems biology. In this research, after introducing two forms of pre-defined component patterns to represent biochemical models, we propose an integrative qualitative and quantitative modelling framework for inferring biochemical systems. In the proposed framework, interactions between reactants in the candidate models for a target biochemical system are evolved and eventually identified by the application of a qualitative model learning approach with an evolution strategy. Kinetic rates of the models generated from qualitative model learning are then further optimised by employing a quantitative approach with simulated annealing. Experimental results indicate that our proposed integrative framework is feasible to learn the relationships between biochemical reactants qualitatively and to make the model replicate the behaviours of the target system by optimising the kinetic rates quantitatively. Moreover, potential reactants of a target biochemical system can be discovered by hypothesising complex reactants in the synthetic models. Based on the biochemical models learned from the proposed framework, biologists can further perform experimental study in wet laboratory. In this way, natural biochemical systems can be better understood.

[1]  Wei Pang,et al.  Learning Qualitative Differential Equation models: a survey of algorithms and applications , 2010, The Knowledge Engineering Review.

[2]  Ross D. King,et al.  On the use of qualitative reasoning to simulate and identify metabolic pathway , 2005, Bioinform..

[3]  Russ B. Altman,et al.  Research Paper: Using Petri Net Tools to Study Properties and Dynamics of Biological Systems , 2004, J. Am. Medical Informatics Assoc..

[4]  Robert King,et al.  Learning Qualitative Models in the Presence of Noise , 2002 .

[5]  Zujian Wu A generic approach to behaviour-driven biochemical model construction , 2012 .

[6]  Wei Pang,et al.  QML-AiNet: An immune network approach to learning qualitative differential equation models , 2015, Appl. Soft Comput..

[7]  Vincenzo Cutello,et al.  Parallel Problem Solving from Nature - PPSN XII , 2012, Lecture Notes in Computer Science.

[8]  Maria Luisa Guerriero,et al.  Qualitative and Quantitative Analysis of a Bio-PEPA Model of the Gp130/JAK/STAT Signalling Pathway , 2009, Trans. Comp. Sys. Biology.

[9]  Ali Abdi,et al.  Quantitative analysis of intracellular communication and signaling errors in signaling networks , 2014, BMC Systems Biology.

[10]  George W. Irwin,et al.  Reverse Engineering of Biochemical Reaction Networks Using Co-evolution with Eng-Genes , 2012, Cognitive Computation.

[11]  Martin Schwarick,et al.  Snoopy - A Unifying Petri Net Tool , 2012, Petri Nets.

[12]  Matteo Sereno,et al.  On the Use of Stochastic Petri Nets in the Analysis of Signal Transduction Pathways for Angiogenesis Process , 2009, CMSB.

[13]  V. N. Reddy,et al.  Qualitative analysis of biochemical reaction systems , 1996, Comput. Biol. Medicine.

[14]  P. Waage,et al.  Studies concerning affinity , 1986 .

[15]  Marta Simeoni,et al.  Petri nets for modelling metabolic pathways: a survey , 2010, Natural Computing.

[16]  Michael L. Mavrovouniotis,et al.  Petri Net Representations in Metabolic Pathways , 1993, ISMB.

[17]  Selahattin Kuru,et al.  Qualitative System Identification: Deriving Structure from Behavior , 1996, Artif. Intell..

[18]  Yangyang Zhao,et al.  BioModels: ten-year anniversary , 2014, Nucleic Acids Res..

[19]  David M. Kramer,et al.  Biochemistry and Molecular Biology , 1968, Nature.

[20]  Wei Pang,et al.  Stepwise modelling of biochemical pathways based on qualitative model learning , 2013, 2013 13th UK Workshop on Computational Intelligence (UKCI).

[21]  Ivan Bratko,et al.  Learning Qualitative Models of Dynamic Systems , 1994, ML.

[22]  Crina Grosan,et al.  Empirical Study of Computational Intelligence Strategies for Biochemical Systems Modelling , 2013, NICSO.

[23]  Monika Heiner,et al.  From Petri Nets to Differential Equations - An Integrative Approach for Biochemical Network Analysis , 2006, ICATPN.

[24]  Parosh Aziz Abdulla,et al.  Tools and Algorithms for the Construction and Analysis of Systems , 1996, Lecture Notes in Computer Science.

[25]  Stephen Gilmore,et al.  Modelling the Influence of RKIP on the ERK Signalling Pathway Using the Stochastic Process Algebra PEPA , 2006, Trans. Comp. Sys. Biology.

[26]  Benjamin Kuipers,et al.  Qualitative Simulation , 1986, Artificial Intelligence.

[27]  Wei Pang,et al.  Learning Qualitative Metabolic Models Using Evolutionary Methods , 2010, 2010 Fifth International Conference on Frontier of Computer Science and Technology.

[28]  Peter Struss,et al.  Qualitative Reasoning , 1997, The Computer Science and Engineering Handbook.

[29]  Anthony G. Cohn,et al.  Qualitative Reasoning , 1987, Advanced Topics in Artificial Intelligence.

[30]  Sang Yup Lee,et al.  WebCell: a web-based environment for kinetic modeling and dynamic simulation of cellular networks , 2006, Bioinform..

[31]  Richard Banks,et al.  Qualitatively modelling and analysing genetic regulatory networks: a Petri net approach , 2007, Bioinform..

[32]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[33]  J. Stenesh,et al.  Dictionary Of Biochemistry And Molecular Biology 2nd ed , 1989 .

[34]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[35]  Serge Haddad,et al.  Application and Theory of Petri Nets , 2012, Lecture Notes in Computer Science.

[36]  Lubos Brim,et al.  Exploring Parameter Space of Stochastic Biochemical Systems Using Quantitative Model Checking , 2013, CAV.

[37]  Andrew J. Millar,et al.  Corrigendum for the paper ‘Digital clocks: simple Boolean models can quantitatively describe circadian systems’ , 2012, Journal of The Royal Society Interface.

[38]  Wei Pang QML-Morven : a framework for learning qualitative models , 2009 .

[39]  Chenxi Shao,et al.  Using Qualitative Description for the Dynamic Analysis of Virus Inflection , 2006, SEAL.

[40]  Annegret Wagler,et al.  Petri nets as a framework for the reconstruction and analysis of signal transduction pathways and regulatory networks , 2011, Natural Computing.

[41]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[42]  Amin Nobakhti,et al.  On Natural Based Optimization , 2010, Cognitive Computation.

[43]  A. Federgruen,et al.  Simulated annealing methods with general acceptance probabilities , 1987, Journal of Applied Probability.

[44]  Hiroshi Matsuno,et al.  Petri Net Based Descriptions for Systematic Understanding of Biological Pathways , 2006, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[45]  Shengxiang Yang,et al.  A Hybrid Approach to Piecewise Modelling of Biochemical Systems , 2012, PPSN.

[46]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[47]  Julio R. Banga,et al.  Reverse engineering and identification in systems biology: strategies, perspectives and challenges , 2014, Journal of The Royal Society Interface.

[48]  Adam Arkin,et al.  Response experiments for nonlinear systems with application to reaction kinetics and genetics. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[49]  Wei Pang,et al.  An immune network approach to learning qualitative models of biological pathways , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[50]  Tadao Murata,et al.  Petri nets: Properties, analysis and applications , 1989, Proc. IEEE.

[51]  Wei Pang,et al.  An integrative top-down and bottom-up qualitative model construction framework for exploration of biochemical systems , 2015, Soft Comput..

[52]  Benjamin J. Kaipers,et al.  Qualitative Simulation , 1989, Artif. Intell..

[53]  Benjamin Kuipers,et al.  Qualitative Simulation: Then and Now , 1993, Artif. Intell..

[54]  W. Jim Zheng,et al.  Signaling network prediction by the Ontology Fingerprint enhanced Bayesian network , 2012, BMC Systems Biology.

[55]  Wei Pang,et al.  QML-Morven: A Novel Framework for Learning Qualitative Models , 2012 .

[56]  Ashwin Srinivasan,et al.  Qualitative System Identification from Imperfect Data , 2008, J. Artif. Intell. Res..

[57]  Benjamin Kuipers,et al.  Automatic Abduction of Qualitative Models , 1992, AAAI.

[58]  J. Peil,et al.  Quantitative Description and Mathematical Modelling of Biological Systems by Means of Nonlinear Approximations – Demonstrated at the Example of the Body Length Growth of Man , 1979 .

[59]  F. Doyle,et al.  A benchmark for methods in reverse engineering and model discrimination: problem formulation and solutions. , 2004, Genome research.

[60]  Mike J. Chantler,et al.  MYCROFT: a framework for qualitative reasoning , 1994 .

[61]  Claudine Chaouiya,et al.  Petri net modelling of biological networks , 2007, Briefings Bioinform..

[62]  Muffy Calder,et al.  Process Algebra Modelling Styles for Biomolecular Processes , 2009, Trans. Comp. Sys. Biology.

[63]  Carmen G. Moles,et al.  Parameter estimation in biochemical pathways: a comparison of global optimization methods. , 2003, Genome research.

[64]  George M. Coghill,et al.  Parallel Fuzzy Qualitative Reasoning , 2005 .

[65]  Andrew Hinton,et al.  PRISM: A Tool for Automatic Verification of Probabilistic Systems , 2006, TACAS.

[66]  Eduardo Sontag,et al.  Untangling the wires: A strategy to trace functional interactions in signaling and gene networks , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[67]  Benjamin Kuipers,et al.  Qualitative reasoning: Modeling and simulation with incomplete knowledge , 1994, Autom..

[68]  P. Milazzo,et al.  Qualitative and Quantitative Formal Modeling of Biological Systems , 2007 .

[69]  Wei Pang,et al.  An immune-inspired approach to qualitative system identification of biological pathways , 2011, Natural Computing.

[70]  Wei Pang,et al.  QML-Morven: A novel framework for learning qualitative differential equation models using both symbolic and evolutionary approaches , 2014, J. Comput. Sci..

[71]  George Macleod Coghill Mycroft : a framework for constraint based fuzzy qualitative reasoning , 1996 .

[72]  Kwang-Hyun Cho,et al.  Mathematical Modeling of the Influence of RKIP on the ERK Signaling Pathway , 2003, CMSB.

[73]  S. Klamt,et al.  Modeling approaches for qualitative and semi-quantitative analysis of cellular signaling networks , 2013, Cell Communication and Signaling.

[74]  W. Kolch,et al.  Mechanism of Suppression of the Raf/MEK/Extracellular Signal-Regulated Kinase Pathway by the Raf Kinase Inhibitor Protein , 2000, Molecular and Cellular Biology.

[75]  David R. Gilbert,et al.  Target driven biochemical network reconstruction based on petri nets and simulated annealing , 2010, CMSB '10.

[76]  Monika Heiner,et al.  A structured approach for the engineering of biochemical network models, illustrated for signalling pathways , 2008, Briefings Bioinform..