Behavior-based intelligent mobile robot using an immunized reinforcement adaptive learning mechanism

Abstract In this paper, a novel immunized reinforcement adaptive learning mechanism employing a behavior-based knowledge and the on-line adapting capabilities of the immune system is proposed and applied to an intelligent mobile robot. Rather than building a detailed mathematical model of immune systems, we try to explore principles in the immune system focusing on its self-organization, adaptive capability and immune memory. Two levels of the immune system, underlying the ‘micro’ level of cell interactions, and emergent ‘macro’ level of the behavior of the system are investigated. To evaluate the proposed immunized architecture, a ‘food foraging work’ simulation environment containing a mobile robot, foods, with/without obstacles is created to simulate the real world. The simulation results validate several significant characteristics of the immunized architecture: adaptability, learning, self-organizing, and stable ecological niche approaching.

[1]  Robin R. Murphy.  Biomimetic search for urban search and rescue , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[2]  N. K. Jerne,et al.  The immune system. , 1973, Scientific American.

[3]  Yoshiki Uchikawa,et al.  Emergent construction of artificial immune networks for autonomous mobile robots , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[4]  John E. Hunt,et al.  An adaptive, distributed learning system based on the immune system , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[5]  Fumihito Arai,et al.  Self-organizing multiple robotic system (a population control through biologically inspired immune network architecture) , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[6]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[7]  Fumihito Arai,et al.  Control of the distributed autonomous robotic system based on the biologically inspired immunological architecture , 1997, Proceedings of International Conference on Robotics and Automation.

[8]  Xin Yao,et al.  Evolutionary Artificial Neural Networks , 1993, Int. J. Neural Syst..

[9]  Hui-Min Huang.  An Architecture and a Methodology for Intelligent Control , 1996, IEEE Expert.

[10]  Kwee-Bo Sim,et al.  Artificial immune network-based cooperative control in collective autonomous mobile robots , 1997, Proceedings 6th IEEE International Workshop on Robot and Human Communication. RO-MAN'97 SENDAI.

[11]  Geoffrey W. Hoffmann,et al.  The immune system: a neglected challenge for network theorists , 1989, IEEE International Symposium on Circuits and Systems,.

[12]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[13]  James L. Crowley,et al.  Learning locomotion reflexes: A self-supervised neural system for a mobile robot , 1994, Robotics Auton. Syst..

[14]  Long Ji Lin,et al.  Self-improving reactive agents based on reinforcement learning, planning and teaching , 1992, Machine Learning.

[15]  A. Coutinho,et al.  A model of the immune network with B-T cell co-operation. I--Prototypical structures and dynamics. , 1996, Journal of theoretical biology.

[16]  Yoshiki Uchikawa,et al.  Emergent construction of behavior arbitration mechanism based on the immune system , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[17]  John J. Grefenstette,et al.  The Evolution of Strategies for Multiagent Environments , 1992, Adapt. Behav..

[18]  D. McFarland.  The Oxford companion to animal behavior , 1981 .

[19]  Yoshiki Uchikawa,et al.  Immunoid: an architecture for behavior arbitration based on the immune networks , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[20]  Richard Owens,et al.  Executable Modal and Temporal Logics: Ijcai '93 Workshop, Chambery, France, August 28, 1993 : Proceedings , 1995, IJCAI 1995.

[21]  Yoshiteru Ishida,et al.  The immune system as a prototype of autonomous decentralized systems: an overview , 1997, Proceedings of the Third International Symposium on Autonomous Decentralized Systems. ISADS 97.

[22]  Koji Yamada,et al.  Immune algorithm for n-TSP , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[23]  Tucker R. Balch,et al.  Motor Schema-Based Formation Control for Multiagent Robot Teams , 1995, ICMAS.

[24]  Francesco Mondada,et al.  Evolution of homing navigation in a real mobile robot , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[25]  Francesco Mondada,et al.  Evolution of neural control structures: some experiments on mobile robots , 1995, Robotics Auton. Syst..

[26]  Pattie Maes,et al.  Situated agents can have goals , 1990, Robotics Auton. Syst..

[27]  Alan S. Perelson,et al.  The Baldwin effect in the immune system: learning by somatic hypermutation , 1996 .

[28]  Alan S. Perelson,et al.  The Evolution of Emergent Organization in Immune System Gene Libraries , 1995, ICGA.

[29]  James S. Albus,et al.  NASA/NBS Standard Reference Model for Telerobot Control System Architecture (NASREM) , 1989 .

[30]  Maja J. Mataric,et al.  Integration of representation into goal-driven behavior-based robots , 1992, IEEE Trans. Robotics Autom..

[31]  Dipankar Dasgupta,et al.  Artificial neural networks and artificial immune systems: similarities and differences , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[32]  D. Dasgupta,et al.  Immunity-based systems: a survey , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[33]  John E. Hunt,et al.  Recognising Promoter Sequences Using An Artificial Immune System , 1995, ISMB.

[34]  S. Forrest,et al.  Antibody repertoires and pathogen recognition: the role of germline diversity and somatic hypermutation , 1999 .

[35]  A. Coutinho,et al.  A model of the immune network with B-T cell co-operation. II--The simulation of ontogenesis. , 1996, Journal of theoretical biology.

[36]  Alan S. Perelson,et al.  The immune system, adaptation, and machine learning , 1986 .

[37]  Kwee-Bo Sim,et al.  Realization of cooperative strategies and swarm behavior in distributed autonomous robotic systems using artificial immune system , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).