Combining GRN modeling and demonstration-based programming for robot control

In recent years, gene regulatory networks (GRNs) have been proposed to work as reliable and robust control mechanisms for robots. Because recurrent neural networks (RNNs) have the unique characteristic of presenting system dynamics over time, we thus adopt such kind of network structure and the principles of gene regulation to develop a biologically and computationally plausible GRN model for robot control. To simulate the regulatory effects and to make our model inferable from time-series data, we also implement an enhanced network-learning algorithm to derive network parameters efficiently. In addition, we present a procedure of programming-by-demonstration to collect behavior sequence data of the robot as expression profiles, and then employ our network-modeling framework to infer controllers. To verify the proposed approach, experiments have been conducted, and the results show that our regulatory model can be inferred for robot control successfully.

[1]  Hidde de Jong,et al.  Modeling and Simulation of Genetic Regulatory Systems: A Literature Review , 2002, J. Comput. Biol..

[2]  Donald C. Wunsch,et al.  Modeling of gene regulatory networks with hybrid differential evolution and particle swarm optimization , 2007, Neural Networks.

[3]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[4]  Hyung-Seok Choi,et al.  Reverse engineering of gene regulatory networks. , 2007, IET systems biology.

[5]  Wei-Po Lee,et al.  Computational methods for discovering gene networks from expression data , 2009, Briefings Bioinform..

[6]  James J. Kuffner,et al.  OpenRAVE: A Planning Architecture for Autonomous Robotics , 2008 .

[7]  Rajesh P. N. Rao,et al.  Learning nonparametric policies by imitation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Martin Trefzer,et al.  Evolution and Analysis of a Robot Controller Based on a Gene Regulatory Network , 2010, ICES.

[9]  Chrystopher L. Nehaniv,et al.  Evolving Embodied Genetic Regulatory Network-Driven Control Systems , 2003, ECAL.

[10]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[11]  Stefano Nolfi,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , 2000 .

[12]  R. Beer.  Dynamical approaches to cognitive science , 2000, Trends in Cognitive Sciences.

[13]  Rüdiger Dillmann,et al.  Teaching and learning of robot tasks via observation of human performance , 2004, Robotics Auton. Syst..

[14]  Randall D. Beer,et al.  Evolving Dynamical Neural Networks for Adaptive Behavior , 1992, Adapt. Behav..

[15]  Yaochu Jin,et al.  A cellular mechanism for multi-robot construction via evolutionary multi-objective optimization of a gene regulatory network , 2009, Biosyst..

[16]  Peter J Bentley,et al.  Methods for improving simulations of biological systems: systemic computation and fractal proteins , 2009, Journal of The Royal Society Interface.

[17]  R. Laubenbacher,et al.  A computational algebra approach to the reverse engineering of gene regulatory networks. , 2003, Journal of theoretical biology.

[18]  Aude Billard,et al.  On Learning, Representing, and Generalizing a Task in a Humanoid Robot , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Guy Karlebach,et al.  Modelling and analysis of gene regulatory networks , 2008, Nature Reviews Molecular Cell Biology.

[20]  Marcel J. T. Reinders,et al.  Regularization and Noise Injection for Improving Genetic Network Models , 2006 .

[21]  Sheng Zhong,et al.  Inferring gene regulatory networks by thermodynamic modeling , 2008, BMC Genomics.

[22]  Toshiharu Taura,et al.  A Study on Acquiring Underlying Behavioral Criteria for Manipulator Motion by Focusing on Learning Efficiency , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[23]  Jiri Vohradsky,et al.  Genexp-a genetic network simulation environment , 2002, Bioinform..

[24]  Jeffrey L. Krichmar,et al.  Evolutionary robotics: The biology, intelligence, and technology of self-organizing machines , 2001, Complex..

[25]  Madan M. Gupta,et al.  Static and Dynamic Neural Networks: From Fundamentals to Advanced Theory , 2003 .

[26]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[27]  Alfredo Colosimo,et al.  A recursive network approach can identify constitutive regulatory circuits in gene expression data , 2005 .

[28]  Natal A. W. van Riel,et al.  Dynamic modelling and analysis of biochemical networks: mechanism-based models and model-based experiments , 2006, Briefings Bioinform..

[29]  L. Hood,et al.  A Genomic Regulatory Network for Development , 2002, Science.

[30]  Hitoshi Iba,et al.  Evolutionary modeling and inference of gene network , 2002, Inf. Sci..

[31]  Christopher M. Bishop,et al.  Current address: Microsoft Research, , 2022 .

[32]  H. Iba,et al.  Inferring Gene Regulatory Networks using Differential Evolution with Local Search Heuristics , 2007, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[33]  Atsushi Nakazawa,et al.  Learning from Observation Paradigm: Leg Task Models for Enabling a Biped Humanoid Robot to Imitate Human Dances , 2007, Int. J. Robotics Res..

[34]  George Konidaris,et al.  METAMorph: Experimenting with Genetic Regulatory Networks for Artificial Development , 2005, ECAL.

[35]  Zhi-Hua Zhou,et al.  Exploratory Under-Sampling for Class-Imbalance Learning , 2006, Sixth International Conference on Data Mining (ICDM'06).

[36]  J. Vohradský.  Neural network model of gene expression , 2001, FASEB journal : official publication of the Federation of American Societies for Experimental Biology.

[37]  Jochen J. Steil,et al.  Task-level imitation learning using variance-based movement optimization , 2009, 2009 IEEE International Conference on Robotics and Automation.

[38]  Robert A. Jacobs,et al.  Increased rates of convergence through learning rate adaptation , 1987, Neural Networks.

[39]  Thomas R. Zentall,et al.  Imitation: definitions, evidence, and mechanisms , 2006, Animal Cognition.

[40]  P J Webros.  BACKPROPAGATION THROUGH TIME: WHAT IT DOES AND HOW TO DO IT , 1990 .