Visual approach skill for a mobile robot using learning and fusion of simple skills

Abstract This paper presents a reinforcement learning algorithm which allows a robot, with a single camera mounted on a pan tilt platform, to learn simple skills such as watch and orientation and to obtain the complex skill called approach combining the previously learned ones. The reinforcement signal the robot receives is a real continuous value so it is not necessary to estimate an expected reward. Skills are implemented with a generic structure which permits complex skill creation from sequencing, output addition and data flow of available simple skills.

[1]  Erann Gat,et al.  Experiences with an architecture for intelligent, reactive agents , 1997, J. Exp. Theor. Artif. Intell..

[2]  R. James Firby,et al.  Task Networks for Controlling Continuous Processes , 1994, AIPS.

[3]  Michael J. Swain,et al.  Task and Environment-Sensitive Tracking, , 1994 .

[4]  Dragan Obradovic,et al.  On-line training of recurrent neural networks with continuous topology adaptation , 1996, IEEE Trans. Neural Networks.

[5]  Yasuhisa Hasegawa,et al.  Learning method for hierarchical behavior controller , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[6]  Rachid Alami,et al.  An Architecture for Autonomy , 1998, Int. J. Robotics Res..

[7]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[8]  François Michaud,et al.  Learning from History for Behavior-Based Mobile Robots in Non-Stationary Conditions , 1998, Machine Learning.

[9]  Ramon Barber,et al.  A New Human Based Architecture for Intelligent Autonomous Robots , 2001 .

[10]  Erann Gat,et al.  Integrating Planning and Reacting in a Heterogeneous Asynchronous Architecture for Controlling Real-World Mobile Robots , 1992, AAAI.

[11]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[12]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[13]  Mark D. Pendrith,et al.  RL-TOPS: An Architecture for Modularity and Re-Use in Reinforcement Learning , 1998, ICML.

[14]  ● Pytorch,et al.  Attention! , 1998, Trends in Cognitive Sciences.

[15]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[16]  Luis Moreno,et al.  Learning Emergent Tasks for an Autonomous Mobile Robot , 1994, IROS.

[17]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[18]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[19]  Jochen Triesch,et al.  GripSee: A Gesture-Controlled Robot for Object Perception and Manipulation , 1999, Auton. Robots.