Navigating a robotic swarm in an uncharted 2D landscape

Navigation is a major issue in robotics due to the necessity for the robots' course of movement. Navigation consists of two essential components known as localization and planning. Localization in robotics refers to one's location with reference to a well known position inside the map. Planning is considered as the computation of a path through a map which represents the environment. This given path would be chosen based on the potential of the problem so that the expected destination would be achieved. As such, a reliable map is essential for navigation without which robots would not be able to accomplish the goals. In navigational approaches, reliability of the map would be challenged due to the dynamic and unpredictable nature of real-world applications. It is, consequently, crucial to implement solutions for searching such environments-those affected by dynamic and noisy constraints. In the present study, two enhanced versions of particle swarm optimization (PSO) called area extension PSO (AEPSO) and cooperative AEPSO (CAEPSO) are employed. During the study, AEPSO and CAEPSO are employed as decision-makers and movement controllers of simulated robots (hereafter referred to as agents). The agents' task is to seek for survivors in realistic simulations based on real-world hostile situations. This study examines the feasibility of AEPSO and CAEPSO on uncertain and time-dependent simulated environments. The simulations follow two phases of training and testing model. Agents use past knowledge gathered during the training phase in their testing phase. The study addresses the impacts of past knowledge, homogeneity and heterogeneity in robotic swarm search. The results demonstrate the feasibility of CAEPSO as robot controller and decision-maker.

[1]  Ellips Masehian,et al.  Classic and Heuristic Approaches in Robot Motion Planning A Chronological Review , 2007 .

[2]  Luca Maria Gambardella,et al.  Metaheuristics in Stochastic Combinatorial Optimization: a Survey , 2006 .

[3]  K. Chang,et al.  The Application of Swarm Engineering Technique to Robust Multi-chain Robot System , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[4]  Somnuk Phon-Amnuaisuk,et al.  Effects of Communication Range, Noise and Help Request Signal on Particle Swarm Optimization with Area Extension (AEPSO) , 2007 .

[5]  Yongji Wang,et al.  Autonomous Robot Path Planning Based on Swarm Intelligence and Stream Functions , 2007, ICES.

[6]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[7]  Yoshikazu Arai,et al.  Multilayered reinforcement learning for complicated collision avoidance problems , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[8]  Sean Luke,et al.  Tunably decentralized algorithms for cooperative target observation , 2005, AAMAS '05.

[9]  Peter J. Bentley,et al.  Perceptive particle swarm optimisation: an investigation , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[10]  De-Bao Sun,et al.  Path planning for mobile robot using the particle swarm optimization with mutation operator , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[11]  Béat Hirsbrunner,et al.  Multi-robot path-planning based on implicit cooperation in a robotic swarm , 1998, AGENTS '98.

[12]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[13]  Yizhen Zhang,et al.  Particle swarm optimization for unsupervised robotic learning , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[14]  Alcherio Martinoli,et al.  Multi-robot learning with particle swarm optimization , 2006, AAMAS '06.

[15]  Pradeep K. Khosla,et al.  Crucial factors affecting cooperative multirobot learning , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  Adham Atyabi.  Navigating Agents In Uncertain Environments Using Particle Swarm Optimisation , 2008 .

[17]  Yasuhiro Tanaka,et al.  Speed up reinforcement learning between two agents with adaptive mimetism , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[18]  Saman K. Halgamuge,et al.  Particle Swarm Optimisation for Protein Motif Discovery , 2004, Genetic Programming and Evolvable Machines.

[19]  Roberto Battiti,et al.  The gregarious particle swarm optimizer (G-PSO) , 2006, GECCO '06.

[20]  Alcherio Martinoli,et al.  Parallel learning in heterogeneous multi-robot swarms , 2007, 2007 IEEE Congress on Evolutionary Computation.

[21]  Kristina Lerman,et al.  A Review of Probabilistic Macroscopic Models for Swarm Robotic Systems , 2004, Swarm Robotics.

[22]  Jong-Hwan Kim,et al.  Modular Q-learning based multi-agent cooperation for robot soccer , 2001, Robotics Auton. Syst..

[23]  David Robertson,et al.  Fourth International Joint Conference on Autonomous Agents and Multi-agent Systems , 2005 .

[24]  Majid Nili Ahmadabadi,et al.  Cooperative Q-learning: the knowledge sharing issue , 2001, Adv. Robotics.

[25]  Somnuk Phon-Amnuaisuk,et al.  Particle swarm optimization with area extension (AEPSO) , 2007, 2007 IEEE Congress on Evolutionary Computation.