The RACE Project - Robustness by Autonomous Competence Enhancement

This paper reports on the aims, the approach, and the results of the European project RACE. The project aim was to enhance the behavior of an autonomous robot by having the robot learn from conceptualized experiences of previous performance, based on initial models of the domain and its own actions in it. This paper introduces the general system architecture; it then sketches some results in detail regarding hybrid reasoning and planning used in RACE, and instances of learning from the experiences of real robot task execution. Enhancement of robot competence is operationalized in terms of performance quality and description length of the robot instructions, and such enhancement is shown to result from the RACE system. 1 Project Aim and Demonstration Domain RACE (Robustness by Autonomous Competence Enhancement) is a project funded by the European Commission under the 7th Framework Programme and running from 12/2011 to 11/2014. The partners are those institutes from which this paper is authored. This short project report summarizes the RACE methodology of working towards achieving these aims, and it sketches main project results, as visible about half a year before the end of the project. The overall aim of RACE as set out in the description of work was to develop an artificial cognitive system, embodied by a service robot, able to build a high-level understanding of the world it inhabits by storing and exploiting appropriate memories of its experiences. Experiences will be recorded internally at multiple levels: high-level descriptions in terms of goals, tasks and behaviours, connected to constituting subtasks, and finally to sensory and actuator skills at the lowest level. In this way, experiences provide a detailed account of how the robot has achieved past goals or how it has failed, and what sensory events have accompanied the activities. Contributions were foreseen in the description of work to advance the state of the art along three lines: 1. robots capable of storing experiences in their memory in terms of multi-level representations connecting actuator and sensory experiences with meaningful high-level structures, 2. methods for learning and generalising from experiences obtained from behaviour in realistically scaled real-world environments, J. Hertzberg (&) M. Günther S. Stock Osnabrück University, Osnabrück, Germany e-mail: joachim.hertzberg@uos.de J. Zhang L. Zhang S. Rockel B. Neumann J. Lehmann Hamburg University, Hamburg, Germany e-mail: zhang@informatik.uni-hamburg.de K. S. R. Dubba A. G. Cohn University of Leeds, Leeds, England A. Saffiotti F. Pecora M. Mansouri Š. Konečný Örebro University, Örebro, Sweden L. S. Lopes M. Oliveira G. H. Lim H. Kasaei V. Mokhtari University of Aveiro, Aveiro, Portugal L. Hotz W. Bohlken HITeC Hamburger Informatik Technologie-Center e. V., Hamburg, Germany

[1]  Jos Lehmann,et al.  A Robot Waiter Learning from Experiences , 2014, MLDM.

[2]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[3]  Bernd Neumann,et al.  Towards Ontology-Based Realtime Behaviour Interpretation , 2013, Human Behavior Recognition Technologies.

[4]  Mark E. J. Newman,et al.  Ego-centered networks and the ripple effect , 2001, Soc. Networks.

[5]  Jos Lehmann,et al.  A Robot Waiter that Predicts Events by High-level Scene Interpretation , 2014, ICAART.

[6]  Jianwei Zhang,et al.  An hyperreality imagination based reasoning and evaluation system (HIRES) , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Gi Hyun Lim,et al.  A perceptual memory system for grounding semantic representations in intelligent service robots , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Hans W. Guesgen Human Behavior Recognition Technologies - Intelligent Applications for Monitoring and Security , 2013, Human Behavior Recognition Technologies.

[9]  Armando J. Pinho,et al.  Gathering and Conceptualizing Plan-Based Robot Activity Experiences , 2014, IAS.

[10]  Gi Hyun Lim,et al.  An interactive open-ended learning approach for 3D object recognition , 2014, 2014 IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC).

[11]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[12]  Federico Pecora,et al.  More knowledge on the table: Planning with space, time and resources for robots , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Yue Cao,et al.  Total-Order Planning with Partially Ordered Subtasks , 2001, IJCAI.

[14]  Alessandro Saffiotti,et al.  Planning Domain + Execution Semantics: A Way Towards Robust Execution? , 2014, AAAI Spring Symposia.

[15]  Anthony G. Cohn,et al.  Grounding Language in Perception for Scene Conceptualization in Autonomous Robots , 2014, AAAI Spring Symposia.

[16]  Franz Baader,et al.  Computing the Least Common Subsumer w.r.t. a Background Terminology , 2004, Description Logics.

[17]  Anthony G. Cohn,et al.  Learning Relational Event Models from Video , 2015, J. Artif. Intell. Res..

[18]  James A. Hendler,et al.  HTN Planning: Complexity and Expressivity , 1994, AAAI.

[19]  Armando J. Pinho,et al.  An Ontology-based Multi-level Robot Architecture for Learning from Experiences , 2013, AAAI Spring Symposium: Designing Intelligent Robots.

[20]  Anthony G. Cohn,et al.  Qualitative and Quantitative Spatio-temporal Relations in Daily Living Activity Recognition , 2014, ACCV.

[21]  D. Gentner Structure‐Mapping: A Theoretical Framework for Analogy* , 1983 .

[22]  Gi Hyun Lim,et al.  Interactive teaching and experience extraction for learning about objects and robot activities , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.