A Dynamic Multiagent Genetic Algorithm for Gene Regulatory Network Reconstruction Based on Fuzzy Cognitive Maps

In order to reconstruct large-scale gene regulatory networks (GRNs) with high accuracy, a robust evolutionary algorithm, a dynamic multiagent genetic algorithm (dMAGA), is proposed to reconstruct GRNs from time-series expression profiles based on fuzzy cognitive maps (FCMs) in this paper. The algorithm is labeled as dMAGAFCM-GRN. In dMAGAFCM-GRN, agents and their behaviors are designed with the intrinsic properties of GRN reconstruction problems in mind. All agents live in a lattice-like environment, and the neighbors of each agent are changed dynamically according to their energy in each generation. dMAGAFCM-GRN can learn continuous states directly for FCMs from data. In the experiments, the performance of dMAGAFCM-GRN is validated on both large-scale synthetic data and the benchmark DREAM3 and DREAM4. The experimental results show that dMAGAFCM-GRN is able to effectively learn FCMs with 200 nodes; that is, 40 000 weights need to be optimized. The systematic comparison with five existing algorithms shows that dMAGAFCM-GRN outperforms all other algorithms and can approximate the time series with high accuracy.

[1]  Afshin Esmaeili,et al.  A multi-objective differential evolutionary approach toward more stable gene regulatory networks , 2009, Biosyst..

[2]  Amit Konar,et al.  A recurrent fuzzy neural model of a gene regulatory network for knowledge extraction using differential evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.

[3]  Adil Baykasoglu,et al.  Training Fuzzy Cognitive Maps via Extended Great Deluge Algorithm with applications , 2011, Comput. Ind..

[4]  Somayeh Alizadeh,et al.  Learning FCM by chaotic simulated annealing , 2009 .

[5]  Witold Pedrycz,et al.  Evolutionary Development of Fuzzy Cognitive Maps , 2005, The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ '05..

[6]  Yuping Wang,et al.  An orthogonal genetic algorithm with quantization for global numerical optimization , 2001, IEEE Trans. Evol. Comput..

[7]  Witold Pedrycz,et al.  Data-driven Nonlinear Hebbian Learning method for Fuzzy Cognitive Maps , 2008, 2008 IEEE International Conference on Fuzzy Systems (IEEE World Congress on Computational Intelligence).

[8]  Elpiniki I. Papageorgiou,et al.  Application of Evolutionary Fuzzy Cognitive Maps for Prediction of Pulmonary Infections , 2012, IEEE Transactions on Information Technology in Biomedicine.

[9]  Jose L. Salmeron,et al.  Methods and Algorithms for Fuzzy Cognitive Map-based Modeling , 2014, Fuzzy Cognitive Maps for Applied Sciences and Engineering.

[10]  Witold Pedrycz,et al.  Genetic learning of fuzzy cognitive maps , 2005, Fuzzy Sets Syst..

[11]  Bart Kosko,et al.  Fuzzy Cognitive Maps , 1986, Int. J. Man Mach. Stud..

[12]  Voula C. Georgopoulos,et al.  A fuzzy cognitive map approach to differential diagnosis of specific language impairment , 2003, Artif. Intell. Medicine.

[13]  Alicja Wakulicz-Deja,et al.  Mining temporal medical data using adaptive fuzzy cognitive maps , 2009, 2009 2nd Conference on Human System Interactions.

[14]  Alina Sîrbu,et al.  Comparison of evolutionary algorithms in gene regulatory network model inference , 2010, BMC Bioinformatics.

[15]  Jose Aguilar,et al.  A Survey about Fuzzy Cognitive Maps Papers (Invited Paper) , 2005 .

[16]  Patrik D'haeseleer,et al.  Genetic network inference: from co-expression clustering to reverse engineering , 2000, Bioinform..

[17]  Patricia Dexter,et al.  Combat entropy as a measure of effectiveness , 2003 .

[18]  Witold Pedrycz,et al.  Numerical and Linguistic Prediction of Time Series With the Use of Fuzzy Cognitive Maps , 2008, IEEE Transactions on Fuzzy Systems.

[19]  Edward R. Dougherty,et al.  Inference of Gene Regulatory Networks using S-System: A Unified Approach , 2007, 2007 IEEE Symposium on Computational Intelligence and Bioinformatics and Computational Biology.

[20]  A. Sîrbu,et al.  Stages of Gene Regulatory Network Inference: the Evolutionary Algorithm Role , 2011 .

[21]  Gustavo Stolovitzky,et al.  Lessons from the DREAM2 Challenges , 2009, Annals of the New York Academy of Sciences.

[22]  Lawrence J. Mazlack,et al.  Learning fuzzy cognitive maps from data by ant colony optimization , 2012, GECCO '12.

[23]  Elpiniki I. Papageorgiou,et al.  Multi-step prediction of pulmonary infection with the use of evolutionary fuzzy cognitive maps , 2012, Neurocomputing.

[24]  Weicai Zhong,et al.  A multiagent genetic algorithm for global numerical optimization , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Hitoshi Iba,et al.  Estimation of gene regulatory network by genetic algorithm and pairwise correlation analysis , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[26]  Chunyan Miao,et al.  Implementation of Fuzzy Cognitive Maps Based on Fuzzy Neural Network and Application in Prediction of Time Series , 2010, IEEE Transactions on Fuzzy Systems.

[27]  Athanasios K. Tsadiras,et al.  Comparing the inference capabilities of binary, trivalent and sigmoid fuzzy cognitive maps , 2008, Inf. Sci..

[28]  Michal Linial,et al.  Using Bayesian Networks to Analyze Expression Data , 2000, J. Comput. Biol..

[29]  Lawrence J. Mazlack,et al.  Inferring Fuzzy Cognitive Map models for Gene Regulatory Networks from gene expression data , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine.

[30]  W. Stach,et al.  Parallel fuzzy cognitive maps as a tool for modeling software development projects , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..

[31]  Jing Liu,et al.  A multiagent evolutionary algorithm for constraint satisfaction problems , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Richard Bonneau,et al.  DREAM4: Combining Genetic and Dynamic Information to Identify Biological Networks and Dynamical Models , 2010, PloS one.

[33]  Witold Pedrycz,et al.  Learning of Fuzzy Cognitive Maps Using Density Estimate , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Hitoshi Iba,et al.  Inference of a gene regulatory network by means of interactive evolutionary computing , 2002, Inf. Sci..

[35]  Chrysostomos D. Stylios,et al.  Fuzzy Cognitive Map Learning Based on Nonlinear Hebbian Rule , 2003, Australian Conference on Artificial Intelligence.

[36]  W. Stach.  Modeling Software Development Projects Using Fuzzy Cognitive Maps , 2004 .

[37]  大介 富永,et al.  逆問題 (inverse problem) 解決のための遺伝的アルゴリズムを用いた多次元非線形数値最適化手法の開発 , 1999 .

[38]  Elpiniki I. Papageorgiou,et al.  A Weight Adaptation Method for Fuzzy Cognitive Maps to a Process Control Problem , 2004, International Conference on Computational Science.

[39]  H. Iba,et al.  Inferring Gene Regulatory Networks using Differential Evolution with Local Search Heuristics , 2007, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[40]  P. Brazhnik,et al.  Linking the genes: inferring quantitative gene networks from microarray data. , 2002, Trends in genetics : TIG.

[41]  Chunyan Miao,et al.  Dynamical cognitive network - an extension of fuzzy cognitive map , 2001, IEEE Trans. Fuzzy Syst..

[42]  Christopher A. Penfold,et al.  How to infer gene networks from expression profiles, revisited , 2011, Interface Focus.

[43]  Elpiniki I. Papageorgiou,et al.  A new methodology for Decisions in Medical Informatics using fuzzy cognitive maps based on fuzzy rule-extraction techniques , 2011, Appl. Soft Comput..

[44]  Michael N. Vrahatis,et al.  A first study of fuzzy cognitive maps learning using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[45]  R Eriksson,et al.  Adapting genetic regulatory models by genetic programming. , 2004, Bio Systems.

[46]  Mostafa Jafari,et al.  Learning FCM by Tabu Search , 2007 .

[47]  Elpiniki I. Papageorgiou,et al.  Fuzzy Cognitive Maps for Applied Sciences and Engineering - From Fundamentals to Extensions and Learning Algorithms , 2013, Fuzzy Cognitive Maps for Applied Sciences and Engineering.

[48]  Mona Singh,et al.  Toward the dynamic interactome: it's about time , 2010, Briefings Bioinform..

[49]  D. E. Koulouriotis,et al.  Learning fuzzy cognitive maps using evolution strategies: a novel schema for modeling and simulating high-level behavior , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[50]  Yuan Yan Tang,et al.  Multi-agent oriented constraint satisfaction , 2002, Artif. Intell..

[51]  Satoru Miyano,et al.  Inferring gene networks from time series microarray data using dynamic Bayesian networks , 2003, Briefings Bioinform..

[52]  Elpiniki I. Papageorgiou,et al.  A weight adaptation method for fuzzy cognitive map learning , 2005, Soft Comput..

[53]  A. Califano,et al.  Dialogue on Reverse‐Engineering Assessment and Methods , 2007, Annals of the New York Academy of Sciences.

[54]  Witold Pedrycz,et al.  A divide and conquer method for learning large Fuzzy Cognitive Maps , 2010, Fuzzy Sets Syst..

[55]  Dirk Repsilber,et al.  Reverse engineering of regulatory networks: simulation studies on a genetic algorithm approach for ranking hypotheses. , 2002, Bio Systems.

[56]  Guy Karlebach,et al.  Modelling and analysis of gene regulatory networks , 2008, Nature Reviews Molecular Cell Biology.

[57]  Elpiniki I. Papageorgiou,et al.  Fuzzy cognitive map ensemble learning paradigm to solve classification problems: Application to autism identification , 2012, Appl. Soft Comput..

[58]  Yiannis S. Boutalis,et al.  Fuzzy Cognitive Maps for Pattern Recognition Applications , 2008, Int. J. Pattern Recognit. Artif. Intell..

[59]  Jing Liu,et al.  A Multiagent Evolutionary Algorithm for Combinatorial Optimization Problems , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[60]  M. Furkan Dodurka,et al.  Goal-oriented decision support using Big Bang-Big Crunch learning based Fuzzy Cognitive Map: An ERP management case study , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[61]  Yunling Peng,et al.  Genome-wide analysis of gene expression profiles during the kernel development of maize (Zea mays L.). , 2008, Genomics.

[62]  Jose L. Salmeron,et al.  A Review of Fuzzy Cognitive Maps Research During the Last Decade , 2013, IEEE Transactions on Fuzzy Systems.

[63]  Sanming Zhou,et al.  Fuzzy causal networks: general model, inference, and convergence , 2006, IEEE Transactions on Fuzzy Systems.

[64]  Amit Bhaya,et al.  Evolving fuzzy rules to model gene expression , 2007, Biosyst..

[65]  Edward Keedwell,et al.  Discovering Gene Networks with a Neural-Genetic Hybrid , 2005, TCBB.

[66]  Yu-Ting Hsiao,et al.  Inferring gene regulatory networks using a hybrid GA-PSO approach with numerical constraints and network decomposition , 2012, Inf. Sci..

[67]  Dario Floreano,et al.  Generating Realistic In Silico Gene Networks for Performance Assessment of Reverse Engineering Methods , 2009, J. Comput. Biol..

[68]  Hidde de Jong,et al.  Modeling and Simulation of Genetic Regulatory Systems: A Literature Review , 2002, J. Comput. Biol..

[69]  Witold Pedrycz,et al.  Parallel Learning of Large Fuzzy Cognitive Maps , 2007, 2007 International Joint Conference on Neural Networks.

[70]  Hitoshi Iba,et al.  Inference of genetic networks using S-system: information criteria for model selection , 2006, GECCO.

[71]  Elpiniki I. Papageorgiou,et al.  Learning Algorithms for Fuzzy Cognitive Maps—A Review Study , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[72]  Julie A. Dickerson,et al.  Creating metabolic and regulatory network models using fuzzy cognitive maps , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[73]  Carsten Peterson,et al.  Random Boolean network models and the yeast transcriptional network , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[74]  Jaap A. Kaandorp,et al.  Efficient parameter estimation for spatio-temporal models of pattern formation: case study of Drosophila melanogaster , 2007, Bioinform..

[75]  Jiming Liu.  Autonomous agents and multi-agent systems : explorations in learning, self-organization and adaptive computation , 2001 .

[76]  Wojciech J Stach,et al.  Learning and aggregation of Fuzzy Cognitive Maps - an evolutionary approach , 2010 .

[77]  Elpiniki I. Papageorgiou,et al.  Optimization of Fuzzy Cognitive Map Model in Clinical Radiotherapy Through Differential Evolution Algorithm , 2003 .