Evolving a Sensory–Motor Interconnection Structure for Adaptive Biped Robot Locomotion

We present an evolving neural oscillator-based bio-inspired biped robot locomotion for minimizing the constraints during the locomotion process. Sensory–motor coordination model is represented by the interconnection between motor neurons and sensory neurons. An evolutionary computation technique is applied for reconstructing the number of joints and the number of neurons in each joint depending on the environmental condition. In this system, either the number of joints, or the number of neurons, or the interconnection structure are dynamically changed depending on the conditions acquired from the sensors that equipped in the robot. Bacterial programming is inspired by the evolutionary process of bacteria, including bacterial mutation and gene transfer. This system is applied in computer simulation for realizing the optimization process and the optimized structure is applied in a small humanoid robot. In experiments, we run the robot in several different environmental conditions. Different neuron structures are resulted depending on the environmental conditions. The proposed tree structure-based optimization strategy can simplify the sensory–motor interconnection structure.

[1]  Hiroshi Shimizu,et al.  Self-organized control of bipedal locomotion by neural oscillators in unpredictable environment , 1991, Biological Cybernetics.

[2]  Krister Wolff,et al.  Structural Evolution of Central Pattern Generators for Bipedal Walking in 3D Simulation , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[3]  Yasuo Kuniyoshi,et al.  Three dimensional bipedal stepping motion using neural oscillators-towards humanoid motion in the real world , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[4]  Naoyuki Kubota,et al.  Combining pose control and angular velocity control for motion balance of humanoid robot soccer EROS , 2014, 2014 IEEE Symposium on Robotic Intelligence in Informationally Structured Space (RiiSS).

[5]  Auke Jan Ijspeert,et al.  A connectionist central pattern generator for the aquatic and terrestrial gaits of a simulated salamander , 2001, Biological Cybernetics.

[6]  Chakravarthini M. Saaj,et al.  Evolving legged robots using biologically inspired optimization strategies , 2010, 2010 IEEE International Conference on Robotics and Biomimetics.

[7]  Helge J. Ritter,et al.  Exploiting inherent regularity in control of multilegged robot locomotion by evolving neural fields , 2011, 2011 Third World Congress on Nature and Biologically Inspired Computing.

[8]  Naoyuki Kubota,et al.  Efficiency energy on humanoid robot walking using evolutionary algorithm , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[9]  Kiyotoshi Matsuoka,et al.  Sustained oscillations generated by mutually inhibiting neurons with adaptation , 1985, Biological Cybernetics.

[10]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[11]  Atilim Günes Baydin,et al.  Evolution of central pattern generators for the control of a five-link bipedal walking mechanism , 2008, Paladyn J. Behav. Robotics.

[12]  Danwei Wang,et al.  Central Pattern Generator Inspired Control for Adaptive Walking of Biped Robots , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Daisuke Sato,et al.  Postural Balance Strategies in Response to Disturbances in the Frontal Plane and Their Implementation With a Humanoid Robot , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  Artyom Topchyan,et al.  Muscle-based skeletal bipedal locomotion using neural evolution , 2013, Ninth International Conference on Computer Science and Information Technologies Revised Selected Papers.

[15]  Gordon Cheng,et al.  Multi-layered multi-pattern CPG for adaptive locomotion of humanoid robots , 2014, Biological Cybernetics.

[16]  A.J. Ijspeert,et al.  Online optimization of modular robot locomotion , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[17]  Kazunori Hase,et al.  Evolutionary generation of human-like bipedal locomotion , 2003 .

[18]  Taesoo Kwon,et al.  Locomotion control for many-muscle humanoids , 2014, ACM Trans. Graph..

[19]  Michiel van de Panne,et al.  Flexible muscle-based locomotion for bipedal creatures , 2013, ACM Trans. Graph..

[20]  Jason Teo,et al.  Using a co-evolutionary approach to automatically generate vertical undulation and lateral rolling motions for snake-like modular robot , 2014, 2014 IEEE International Symposium on Robotics and Manufacturing Automation (ROMA).

[21]  László T. Kóczy,et al.  Genetic and Bacterial Programming for B-Spline Neural Networks Design , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[22]  Ivan Tanev,et al.  Interactive learning of consensus sequences in genetic programming for evolution of snake-like robot , 2007, 2007 IEEE Congress on Evolutionary Computation.

[23]  Naoyuki Kubota,et al.  Interconnection Structure Optimization for Neural Oscillator Based Biped Robot Locomotion , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[24]  Jong-Hwan Kim,et al.  Full-body joint trajectory generation using an evolutionary central pattern generator for stable bipedal walking , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Sooyol Ok,et al.  Evolving bipedal locomotion with genetic programming - a preliminary report , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[26]  Kyrre Glette,et al.  Evolution of artificial muscle-based robotic locomotion in PhysX , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Auke Jan Ijspeert,et al.  Gait Transition from Swimming to Walking: Investigation of Salamander Locomotion Control Using Nonlinear Oscillators , 2006 .

[28]  Takeshi Furuhashi,et al.  Fuzzy system parameters discovery by bacterial evolutionary algorithm , 1999, IEEE Trans. Fuzzy Syst..

[29]  Ivan Tanev,et al.  Genetic programming incorporating biased mutation for evolution and adaptation of Snakebot , 2007, Genetic Programming and Evolvable Machines.

[30]  Tüze Kuyucu,et al.  Genetic transposition inspired incremental genetic programming for efficient coevolution of locomotion and sensing of simulated snake-like robot , 2011, ECAL.

[31]  Vladlen Koltun,et al.  Optimizing locomotion controllers using biologically-based actuators and objectives , 2012, ACM Trans. Graph..

[32]  Naoyuki Kubota,et al.  Evolving spiking neural network for robot locomotion generation , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[33]  Jun-Ho Oh,et al.  Experimental realization of dynamic walking of the biped humanoid robot KHR-2 using zero moment point feedback and inertial measurement , 2006, Adv. Robotics.

[34]  Cristina P. Santos,et al.  Genetic programming applied to biped locomotion control with sensory information , 2014, 2014 11th International Conference on Informatics in Control, Automation and Robotics (ICINCO).

[35]  Krister Wolff,et al.  Evolution of biped locomotion using linear genetic programming , 2007 .

[36]  Auke Jan Ijspeert,et al.  Central pattern generators for locomotion control in animals and robots: A review , 2008, Neural Networks.

[37]  Naoyuki Kubota,et al.  Bézier curve model for efficient bio-inspired locomotion of low cost four legged robot , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[38]  Charles E. Taylor.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. Complex Adaptive Systems.John H. Holland , 1994 .

[39]  László T. Kóczy,et al.  Hierarchical fuzzy system modeling by Genetic and Bacterial Programming approaches , 2010, International Conference on Fuzzy Systems.

[40]  Kiyotoshi Matsuoka,et al.  Mechanisms of frequency and pattern control in the neural rhythm generators , 1987, Biological Cybernetics.

[41]  Naoyuki Kubota,et al.  Multi-objective evolutionary algorithm for neural oscillator based robot locomotion , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[42]  Vítor Matos,et al.  Towards goal-directed biped locomotion: Combining CPGs and motion primitives , 2014, Robotics Auton. Syst..

[43]  Andrew H. Fagg,et al.  Genetic programming approach to the construction of a neural network for control of a walking robot , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[44]  Cristina P. Santos,et al.  Automatic generation of biped locomotion controllers using genetic programming , 2014, Robotics Auton. Syst..

[45]  Naoyuki Kubota,et al.  Biologically Inspired Control System for 3-D Locomotion of a Humanoid Biped Robot , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.