Bio-inspired approach to learning robot motion trajectories and visual control commands

We propose a robust bio-inspired learning control approach (BILCA) for mobile robots.Novel approach treats the robot trajectory learning and visual homing problems.First paper to integrate metaheuristic algorithm and trajectory learning problem in robots.First paper to integrate metaheuristic technique and visual homing strategy in robots.Various simulations and a real world experiment confirm applicability and usefulness of BILCA. In this paper, a novel bio-inspired learning control approach (BILCA) for mobile robots based on Learning from Demonstration (LfD), Firefly Algorithm (FA), and homography between current and target camera view is developed. BILCA consists of two steps: (i) first step in which the actuator commands are learned using FA and demonstrations of desired behavior, and (ii) second step in which the obtained wheel commands are evaluated through the real world experiment. Two different problems are considered in this study: trajectory reproduction, and generation of visual control commands for correction of robot orientation. Developed simulations are used to evaluate BILCA in the domain of learning actuator commands for reproduction of different complex trajectories. Results show that the bigger firefly swarms produce better results in terms of accuracy in the final mobile robot pose, and that the desired trajectory is reproduced with minimal error in final control iteration. Likewise, simulations prove that the FA outperforms other metaheuristic techniques. Experiment conducted on a real mobile robot in indoor environment unifies two considered problems within a single transportation task. Depending of the feature position in the image plane, the homography controller for forward motion or the BILCA based controller for robot orientation correction is employed. Experimental results show the applicability and effectiveness of the developed intelligent approach in real world conditions.

[1]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[3]  Zoran Miljkovic,et al.  Neural network learning from demonstration and epipolar geometry for visual control of a nonholonomic mobile robot , 2014, Soft Comput..

[4]  Seung-Hwan Choi,et al.  Evolutionary multi-objective optimization in robot soccer system for education , 2009, IEEE Comput. Intell. Mag..

[5]  Jonathan M. Roberts,et al.  Vision-based operations of a large industrial vehicle: Autonomous hot metal carrier , 2008 .

[6]  Brett Browning,et al.  Learning robot motion control with demonstration and advice-operators , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Josechu J. Guerrero,et al.  Homography-Based Visual Control of Nonholonomic Vehicles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[8]  Rong-Jong Wai,et al.  Fuzzy-Neural-Network Inherited Sliding-Mode Control for Robot Manipulator Including Actuator Dynamics , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Xin-She Yang,et al.  Engineering Optimization: An Introduction with Metaheuristic Applications , 2010 .

[10]  Marco Dorigo,et al.  From Fireflies to Fault-Tolerant Swarms of Robots , 2009, IEEE Transactions on Evolutionary Computation.

[11]  Xin-She Yang,et al.  A Discrete Firefly Algorithm for the Multi-Objective Hybrid Flowshop Scheduling Problems , 2014, IEEE Transactions on Evolutionary Computation.

[12]  Cédric Hartland,et al.  Using echo state networks for robot navigation behavior acquisition , 2007, 2007 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[13]  Chia-Feng Juang,et al.  Evolutionary Robot Wall-Following Control Using Type-2 Fuzzy Controller With Species-DE-Activated Continuous ACO , 2013, IEEE Transactions on Fuzzy Systems.

[14]  Gonzalo López-Nicolás,et al.  Visual Control for Multirobot Organized Rendezvous , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Torsten Bertram,et al.  Acquisition of Behavioral Dynamics for Vision Based Mobile Robot Navigation from Demonstrations , 2013 .

[16]  Spring Berman,et al.  Experimental Study and Modeling of Group Retrieval in Ants as an Approach to Collective Transport in Swarm Robotic Systems , 2011, Proceedings of the IEEE.

[17]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[18]  Zoran Miljkovic,et al.  Neural network Reinforcement Learning for visual control of robot manipulators , 2013, Expert Syst. Appl..

[19]  Sylvain Calino,et al.  Robot programming by demonstration : a probabilistic approach , 2009 .

[20]  Amir Hossein Gandomi,et al.  Chaotic bat algorithm , 2014, J. Comput. Sci..

[21]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[22]  Gonzalo López-Nicolás,et al.  Shortest Path Homography-Based Visual Control for Differential Drive Robots , 2007 .

[23]  José Santos-Victor,et al.  Visual learning by imitation with motor representations , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Rahul Kala,et al.  Multi-robot path planning using co-evolutionary genetic programming , 2012, Expert Syst. Appl..

[25]  Warren E. Dixon,et al.  Homography-based visual servo regulation of mobile robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Andrew T. Irish,et al.  TRAJECTORY LEARNING BASED ON CONDITIONAL RANDOM FIELDS FOR ROBOT PROGRAMMING BY DEMONSTRATION , 2010 .

[27]  Andrew T. Irish,et al.  Trajectory Learning for Robot Programming by Demonstration Using Hidden Markov Model and Dynamic Time Warping , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  José Santos-Victor,et al.  A Developmental Roadmap for Learning by Imitation in Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Bojan Babić,et al.  New hybrid vision-based control approach for automated guided vehicles , 2013 .

[30]  Nicholas R. Gans,et al.  Homography-Based Control Scheme for Mobile Robots With Nonholonomic and Field-of-View Constraints , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Ewald von Puttkamer,et al.  A behavior-based mobile robot architecture for Learning from Demonstration , 2001, Robotics Auton. Syst..

[32]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[33]  Rüdiger Dillmann,et al.  Incremental Learning of Tasks From User Demonstrations, Past Experiences, and Vocal Comments , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Eric Fritzinger,et al.  Learning behavior fusion from demonstration , 2008 .

[35]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[36]  Bin Wang,et al.  Staying-alive path planning with energy optimization for mobile robots , 2012, Expert Syst. Appl..

[37]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[38]  Ferrante Neri,et al.  Memetic Compact Differential Evolution for Cartesian Robot Control , 2010, IEEE Computational Intelligence Magazine.

[39]  Oscar Castillo,et al.  Optimal design of type-2 and type-1 fuzzy tracking controllers for autonomous mobile robots under perturbed torques using a new chemical optimization paradigm , 2013, Expert Syst. Appl..

[40]  Janez Brest,et al.  A comprehensive review of firefly algorithms , 2013, Swarm Evol. Comput..

[41]  Amitava Chatterjee,et al.  A PSO–Lyapunov Hybrid Stable Adaptive Fuzzy Tracking Control Approach for Vision-Based Robot Navigation , 2012, IEEE Transactions on Instrumentation and Measurement.

[42]  Ki-Baek Lee,et al.  Multiobjective Particle Swarm Optimization With Preference-Based Sort and Its Application to Path Following Footstep Optimization for Humanoid Robots , 2013, IEEE Transactions on Evolutionary Computation.

[43]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[44]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[45]  Chia-Feng Juang,et al.  Evolutionary-Group-Based Particle-Swarm-Optimized Fuzzy Controller With Application to Mobile-Robot Navigation in Unknown Environments , 2011, IEEE Transactions on Fuzzy Systems.

[46]  Gonzalo López-Nicolás,et al.  Visual control of vehicles using two-view geometry , 2010 .

[47]  Roderic A. Grupen,et al.  A model of shared grasp affordances from demonstration , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[48]  Ruey-Jing Lian,et al.  Adaptive Self-Organizing Fuzzy Sliding-Mode Radial Basis-Function Neural-Network Controller for Robotic Systems , 2014, IEEE Transactions on Industrial Electronics.

[49]  Åke Wernersson,et al.  Docking to pallets with feedback from a sheet-of-light range camera , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).