Human inspired robotic path planning and heterogeneous robotic mapping

One of the biggest challenges facing robotics is the ability for a robot to autonomously navigate real-world unknown environments and is considered by many to be a key prerequisite of truly autonomous robots. Autonomous navigation is a complex problem that requires a robot to solve the three problems of navigation: localisation, goal recognition, and pathplanning. Conventional approaches to these problems rely on computational techniques that are inherently rigid and brittle. That is, the underlying models cannot adapt to novel input, nor can they account for all potential external conditions, which could result in erroneous or misleading decision making. In contrast, humans are capable of learning from their prior experiences and adapting to novel situations. Humans are also capable of sharing their experiences and knowledge with other humans to bootstrap their learning. This is widely thought to be an important part of the success of humanity by allowing high-fidelity transmission of information and skills between individuals, facilitating cumulative knowledge gain. Furthermore, human cognition is influenced by internal emotion states. Historically considered to be a detriment to a person’s cognitive process, recent research is regarding emotions as a beneficial mechanism in the decision making process by facilitating the transfer of simple, but high-impact information. Human created control approaches are inherently rigid and cannot account for the complexity of behaviours required for autonomous navigation. The proposed thesis is that cognitive inspired mechanisms can address limitations in current robotic navigation techniques by allowing robots to autonomously learn beneficial behaviours from interacting in their environment. The first objective is to enable the sharing of navigation information between heterogeneous robotic platforms. The second objective is to add flexibility to rigid path-planning approaches by utilising emotions as low-level but high-impact behavioural responses. Inspired by cognitive sciences, a novel cognitive mapping approach is presented that functions in conjunction with current localisation techniques. The cognitive mapping stage utilises an Anticipatory Classifier System (ACS) to learn the novel Cognitive Action Map (CAM) of decision points, areas in which a robot must determine its next action (direction of travel). These physical actions provide a shared means of understanding the environment to allow for the transferring of learned navigation information. The presented cognitive mapping approach has been trained and evaluated on real-world robotic platforms. The results show the successful sharing of navigation information between two heterogeneous robotic platforms with different sensing capabilities. The results have also demonstrated the novel contribution of autonomously sharing navigation information between a range-based (GMapping) and vision-based (RatSLAM) localisation approach for the first time. The advantage of sharing information between localisation techniques allows an individual robotic platform to utilise the best fit localisation approach for its sensors while still being able to provide useful navigation information for robots with different sensor types. Inspired by theories on natural emotions, this work presents a novel emotion model designed to improve a robot’s navigation performance through learning to adapt a rigid path-planning approach. The model is based on the concept of a bow-tie structure, linking emotional reinforcers and behavioural modifiers through intermediary emotion states. An important function of the emotions in the model is to provide a compact set of high-impact behaviour adaptations, reducing an otherwise tangled web of stimulus-response patterns. Crucially, the system learns these emotional responses with no human pre-specifying the behaviour of the robot, hence avoiding human bias. The results of training the emotion model demonstrate that it is capable of learning up to three emotion states for robotic navigation without human bias: fear, apprehension, and happiness. The fear and apprehension responses slow the robot’s speed and drive the robot away from obstacles when the robot experiences pain, or is uncertain of its current position. The happiness response increases the speed of the robot and reduces the safety margins around obstacles when pain is absent, allowing the robot to drive closer to obstacles. These learned emotion responses have improved the navigation performance of the robot by reducing collisions and navigation times, in both simulated and real-world experiments. The two emotion model (fear and happiness) improved performance the most, indicating that a robot may only require two emotion states (fear and happiness) for navigation in common, static domains.

[1]  J. V. Wood,et al.  Does affect induce self-focused attention? , 1990, Journal of personality and social psychology.

[2]  Ruben C. Gur,et al.  Anger under Control: Neural Correlates of Frustration as a Function of Trait Aggression , 2013, PloS one.

[3]  Dale A. Carnegie,et al.  Robotic Emotions: Navigation with Feeling , 2009 .

[4]  Wolfgang Stolzmann,et al.  An Introduction to Anticipatory Classifier Systems , 1999, Learning Classifier Systems.

[5]  Michael Milford,et al.  Image region salience for improving appearance-based place recognition using a supervised classifier system , 2012, ICRA 2012.

[6]  Roderic A. Grupen,et al.  Robust Reinforcement Learning in Motion Planning , 1993, NIPS.

[7]  C. P. van Wilgen,et al.  The sensitization model to explain how chronic pain exists without tissue damage. , 2012, Pain management nursing : official journal of the American Society of Pain Management Nurses.

[8]  Kurt Konolige,et al.  Incremental mapping of large cyclic environments , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[9]  Sebastian Thrun,et al.  A Personal Account of the Development of Stanley, the Robot That Won the DARPA Grand Challenge , 2006, AI Mag..

[10]  Paul Newman,et al.  Scene Signatures: Localised and Point-less Features for Localisation , 2014, Robotics: Science and Systems.

[11]  Warren B. Powell,et al.  AI, OR and Control Theory: A Rosetta Stone for Stochastic Optimization , 2012 .

[12]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  Zhanna V. Zatuchna AgentP Model: Learning Classifier System with Associative Perception , 2004, PPSN.

[14]  Nando de Freitas,et al.  Rao-Blackwellised Particle Filtering for Dynamic Bayesian Networks , 2000, UAI.

[15]  Niko Sünderhauf,et al.  Predicting the change - A step towards life-long operation in everyday environments , 2013 .

[16]  Dale A. Carnegie,et al.  Robotic competitions: short term pain for long term gain , 2014 .

[17]  Kai Song,et al.  Approach to Nonlinear Blind Source Separation Based on Niche Genetic Algorithm , 2006, ISDA.

[18]  Martin V. Butz,et al.  An algorithmic description of XCS , 2000, Soft Comput..

[19]  Anthony Stentz,et al.  The Focussed D* Algorithm for Real-Time Replanning , 1995, IJCAI.

[20]  Kurt Konolige,et al.  FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping , 2008, IEEE Transactions on Robotics.

[21]  Gordon Wyeth,et al.  Transforming morning to afternoon using linear regression techniques , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[23]  A. Craig A new view of pain as a homeostatic emotion , 2003, Trends in Neurosciences.

[24]  Lindsay Kleeman,et al.  Robust Appearance Based Visual Route Following for Navigation in Large-scale Outdoor Environments , 2009, Int. J. Robotics Res..

[25]  Gordon Wyeth,et al.  Robust outdoor visual localization using a three‐dimensional‐edge map , 2009, J. Field Robotics.

[26]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[27]  A. Martin V. Butz,et al.  The anticipatory classifier system and genetic generalization , 2002, Natural Computing.

[28]  Jean-Arcady Meyer,et al.  Map-based navigation in mobile robots: I. A review of localization strategies , 2003, Cognitive Systems Research.

[29]  David E. Goldberg,et al.  Genetic algorithms and Machine Learning , 1988, Machine Learning.

[30]  K. Boulding,et al.  The Image: Knowledge in Life and Society. , 1956 .

[31]  K. Warwick,et al.  Historical and current machine intelligence , 2006, IEEE Instrumentation & Measurement Magazine.

[32]  Martin V. Butz,et al.  How XCS evolves accurate classifiers , 2001 .

[33]  K. Laland,et al.  THE EVOLUTION OF TEACHING , 2011, Evolution; international journal of organic evolution.

[34]  Ursula Hess,et al.  Darwin and emotion expression. , 2009, The American psychologist.

[35]  Martin V. Butz,et al.  Learning classifier systems , 2010, GECCO '10.

[36]  Stewart W. Wilson ZCS: A Zeroth Level Classifier System , 1994, Evolutionary Computation.

[37]  Gordon Wyeth,et al.  RatSLAM: a hippocampal model for simultaneous localization and mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[38]  K. Scherer,et al.  The Relationship of Emotion to Cognition: A Functional Approach to a Semantic Controversy , 1987 .

[39]  Philip J. Smith,et al.  Brittleness in the design of cooperative problem-solving systems: the effects on user performance , 1997, IEEE Trans. Syst. Man Cybern. Part A.

[40]  Michael Milford,et al.  Towards Vision-Based Pose- and Condition-Invariant Place Recognition along Routes , 2014, ICRA 2014.

[41]  R. Downs,et al.  Cognitive Maps and Spatial Behaviour: Process and Products , 2011 .

[42]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  E. Rolls Précis of The brain and emotion. , 2000, The Behavioral and brain sciences.

[44]  Dale Anthony Carnegie,et al.  Emotion inspired adaptive robotic path planning , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[45]  Ronald C. Arkin,et al.  Human perspective on affective robotic behavior: a longitudinal study , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Eduardo Mario Nebot,et al.  Consistency of the EKF-SLAM Algorithm , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  Stewart W. Wilson Classifier Fitness Based on Accuracy , 1995, Evolutionary Computation.

[48]  A. Isen,et al.  An Influence of Positive Affect on Decision Making in Complex Situations: Theoretical Issues With Practical Implications , 2001 .

[49]  Jean-Claude Latombe,et al.  Robot motion planning , 1970, The Kluwer international series in engineering and computer science.

[50]  Dehua Li,et al.  Learning classifier systems with memory condition to solve non-Markov problems , 2012, Soft Computing.

[51]  W. Prinz,et al.  An online neural substrate for sense of agency. , 2013, Cerebral cortex.

[52]  Gordon Wyeth,et al.  CAT-SLAM: probabilistic localisation and mapping using a continuous appearance-based trajectory , 2012, Int. J. Robotics Res..

[53]  Emilio Corchado,et al.  A survey of multiple classifier systems as hybrid systems , 2014, Inf. Fusion.

[54]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[55]  M. Dawkins Animal Minds and Animal Emotions1 , 2000 .

[56]  Hiroyuki Ishii,et al.  A novel method to develop an animal model of depression using a small mobile robot , 2013, Adv. Robotics.

[57]  David E. Goldberg,et al.  A Critical Review of Classifier Systems , 1989, ICGA.

[58]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[59]  R. Plutchik A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION , 1980 .

[60]  Simon X. Yang,et al.  A knowledge based genetic algorithm for path planning of a mobile robot , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[61]  Lucia F Jacobs,et al.  Unpacking the cognitive map: the parallel map theory of hippocampal function. , 2003, Psychological review.

[62]  Tim Kovacs,et al.  Foundations of learning classifier systems: An introduction , 2005 .

[63]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[64]  Cynthia Breazeal,et al.  Emotion and sociable humanoid robots , 2003, Int. J. Hum. Comput. Stud..

[65]  Anthony J. Bagnall,et al.  A learning classifier system for mazes with aliasing clones , 2009, Natural Computing.

[66]  Andrea Bonarini,et al.  An Introduction to Learning Fuzzy Classifier Systems , 1999, Learning Classifier Systems.

[67]  Paul Newman,et al.  Highly scalable appearance-only SLAM - FAB-MAP 2.0 , 2009, Robotics: Science and Systems.

[68]  Houjun Wang,et al.  Improved Genetic Algorithms Based Path planning of Mobile Robot Under Dynamic Unknown Environment , 2006, 2006 International Conference on Mechatronics and Automation.

[69]  Dale Anthony Carnegie,et al.  Learned Action SLAM: Sharing SLAM through learned path planning information between heterogeneous robotic platforms , 2017, Appl. Soft Comput..

[70]  Mengjie Zhang,et al.  Reusing Building Blocks of Extracted Knowledge to Solve Complex, Large-Scale Boolean Problems , 2014, IEEE Transactions on Evolutionary Computation.

[71]  Rüdiger Dillmann,et al.  Learning Robot Behaviour and Skills Based on Human Demonstration and Advice: The Machine Learning Paradigm , 2000 .

[72]  Geoffrey A. Hollinger,et al.  Design of a Social Mobile Robot Using Emotion-Based Decision Mechanisms , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[73]  Will N. Browne,et al.  Integration of Learning Classifier Systems with simultaneous localisation and mapping for autonomous robotics , 2012, 2012 IEEE Congress on Evolutionary Computation.

[74]  Richard S. Sutton,et al.  Reinforcement Learning is Direct Adaptive Optimal Control , 1992, 1991 American Control Conference.

[75]  Pattie Maes,et al.  Cathexis: a computational model of emotions , 1997, AGENTS '97.

[76]  Roland Siegwart,et al.  Introduction to Autonomous Mobile Robots , 2004 .

[77]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[78]  Anthony Stentz,et al.  A Guide to Heuristic-based Path Planning , 2005 .

[79]  Alan Page Fiske,et al.  Structures of social life : the four elementary forms of human relations : communal sharing, authority ranking, equality matching, market pricing : with a new epilogue , 1991 .

[80]  Peter Cheeseman,et al.  On the Representation and Estimation of Spatial Uncertainty , 1986 .

[81]  Sebastian Thrun,et al.  FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges , 2003, IJCAI 2003.

[82]  Jean-Marc Fellous,et al.  From human emotions to robot emotions , 2004, AAAI 2004.

[83]  Peter I. Corke,et al.  All-environment visual place recognition with SMART , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[84]  P. Ekman Facial expression and emotion. , 1993, The American psychologist.

[85]  Bruce J. MacLennan,et al.  Robots React, but Can They Feel? , 2009 .

[86]  J. Doyle,et al.  Bow Ties, Metabolism and Disease , 2022 .

[87]  Larry Bull,et al.  Learning Classifier Systems: A Brief Introduction , 2004 .

[88]  John J. Leonard,et al.  Adaptive Mobile Robot Navigation and Mapping , 1999, Int. J. Robotics Res..

[89]  R. Arkin Moving Up the Food Chain: Motivation and Emotion in Behavior-Based Robots , 2003 .

[90]  Tim Bailey,et al.  Non-parametric Learning to Aid Path Planning over Slopes , 2009, Int. J. Robotics Res..

[91]  Hisao Ishibuchi,et al.  Performance evaluation of fuzzy classifier systems for multidimensional pattern classification problems , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[92]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[93]  Mengjie Zhang,et al.  XCSR with Computed Continuous Action , 2012, Australasian Conference on Artificial Intelligence.

[94]  Anthony G. Pipe,et al.  Fuzzy classifier system architectures for mobile robotics: An experimental comparison , 2007, Int. J. Intell. Syst..

[95]  Martin V. Butz,et al.  An Algorithmic Description of ACS2 , 2001, International Workshop on Learning Classifier Systems.

[96]  Janet Wiles,et al.  OpenRatSLAM: an open source brain-based SLAM system , 2013, Autonomous Robots.

[97]  Kang Li,et al.  A gradient-guided niching method in genetic algorithm for solving continuous optimisation problems , 2002, Proceedings of the 4th World Congress on Intelligent Control and Automation (Cat. No.02EX527).

[98]  Cynthia Breazeal,et al.  Function meets style: insights from emotion theory applied to HRI , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[99]  Marco Dorigo,et al.  Genetics-based machine learning and behavior-based robotics: a new synthesis , 1993, IEEE Trans. Syst. Man Cybern..

[100]  Edwin Olson,et al.  A General Purpose Feature Extractor for Light Detection and Ranging Data , 2010, Sensors.

[101]  Yiannis Demiris,et al.  Learning Forward Models for Robots , 2005, IJCAI.

[102]  Zoubin Ghahramani,et al.  Perspectives and problems in motor learning , 2001, Trends in Cognitive Sciences.

[103]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[104]  David Filliat,et al.  Map-based navigation in mobile robots: II. A review of map-learning and path-planning strategies , 2003, Cognitive Systems Research.

[105]  Kurt Konolige,et al.  The Office Marathon: Robust navigation in an indoor office environment , 2010, 2010 IEEE International Conference on Robotics and Automation.

[106]  Michael Milford,et al.  Towards Brain-based Sensor Fusion for Navigating Robots , 2012, ICRA 2012.

[107]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..