Self-Understanding and Self-Extension: A Systems and Representational Approach

There are many different approaches to building a system that can engage in autonomous mental development. In this paper, we present an approach based on what we term self-understanding, by which we mean the explicit representation of and reasoning about what a system does and does not know, and how that knowledge changes under action. We present an architecture and a set of representations used in two robot systems that exhibit a limited degree of autonomous mental development, which we term self-extension. The contributions include: representations of gaps and uncertainty for specific kinds of knowledge, and a goal management and planning system for setting and achieving learning goals.

[1]  Fahiem Bacchus,et al.  A Knowledge-Based Approach to Planning with Incomplete Information and Sensing , 2002, AIPS.

[2]  Nick Hawes,et al.  Engineering intelligent information-processing systems with CAST , 2010, Adv. Eng. Informatics.

[3]  Bernhard Nebel,et al.  Continual planning and acting in dynamic multiagent environments , 2006, PCAR '06.

[4]  Leslie Pack Kaelbling,et al.  The Synthesis of Digital Machines With Provable Epistemic Properties , 1986, TARK.

[5]  Colleen M. Seifert,et al.  Opportunistic Planning: Being Reminded of Pending Goals , 1997, Cognitive Psychology.

[6]  J. Gregory Trafton,et al.  Spatial Representation and Reasoning for Human-Robot Collaboration , 2007, AAAI.

[7]  Bernhard Nebel,et al.  COMPLEXITY RESULTS FOR SAS+ PLANNING , 1995, Comput. Intell..

[8]  Marc Hanheide,et al.  Mixed-initiative in human augmented mapping , 2009, 2009 IEEE International Conference on Robotics and Automation.

[9]  Benjamin Kuipers,et al.  The Spatial Semantic Hierarchy , 2000, Artif. Intell..

[10]  Danijel Skocaj,et al.  Online kernel density estimation for interactive learning , 2010, Image Vis. Comput..

[11]  Cipriano Galindo,et al.  Multi-hierarchical semantic maps for mobile robotics , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Jürgen Schmidhuber,et al.  Curious model-building control systems , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[13]  Kristoffer Sjöö,et al.  Planning as an architectural control mechanism , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[14]  Héctor H. González-Baños,et al.  A randomized art-gallery algorithm for sensor placement , 2001, SCG '01.

[15]  Deb Roy,et al.  Semiotic schemas: A framework for grounding language in action and perception , 2005, Artif. Intell..

[16]  Danijel Skocaj,et al.  A computer vision integration model for a multi-modal cognitive system , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Sven Wachsmuth,et al.  An integrated system for cooperative man-machine interaction , 2001, Proceedings 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation (Cat. No.01EX515).

[18]  Juan Carlos Peris Broch,et al.  Cognitive Maps for Mobile Robot Navigation : A Hybrid Representation Using Reference Systems 1 , 2022 .

[19]  Danijel Skocaj,et al.  Continuous Learning of Simple Visual Concepts Using Incremental Kernel Density Estimation , 2016, VISAPP.

[20]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .

[21]  Alexandra M. Coddington Integrating motivations with planning , 2007, AAMAS '07.

[22]  Hector J. Levesque,et al.  What Is Planning in the Presence of Sensing? , 1996, AAAI/IAAI, Vol. 2.

[23]  Wolfram Burgard,et al.  Information Gain-based Exploration Using Rao-Blackwellized Particle Filters , 2005, Robotics: Science and Systems.

[24]  Danijel Skocaj,et al.  Formalization of different learning strategies in a continuous domain framework , 2009, EpiRob.

[25]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[26]  Peter Cheeseman,et al.  A stochastic map for uncertain spatial relationships , 1988 .

[27]  Ben J. A. Kröse,et al.  BIRON, where are you? Enabling a robot to learn new places in a real home environment by integrating spoken dialog and visual localization , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Philip S. Yu,et al.  Active Mining of Data Streams , 2004, SDM.

[29]  C. Breazeal,et al.  Experiments in socially guided exploration: lessons learned in building robots that learn with and without human teachers , 2008, Connect. Sci..

[30]  Benjamin Kuipers,et al.  The initial development of object knowledge by a learning robot , 2008, Robotics Auton. Syst..

[31]  Norbert Pfleger,et al.  Modality Fusion , 2006, SmartKom.

[32]  Patric Jensfelt,et al.  Stochastically convergent localization of objects and actively controllable sensor-object pose , 2009 .

[33]  Tom Bylander,et al.  Complexity Results for Planning , 1991, IJCAI.

[34]  Alex Pentland,et al.  Learning words from sights and sounds: a computational model , 2002, Cogn. Sci..

[35]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[36]  Wolfram Burgard,et al.  Conceptual spatial representations for indoor mobile robots , 2008, Robotics Auton. Syst..

[37]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[38]  Nico Blodow,et al.  Towards 3D Point cloud based object maps for household environments , 2008, Robotics Auton. Syst..

[39]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[40]  Paul J. Walmsley,et al.  Bayesian Approaches to Multi-Sensor Data Fusion , 1999 .

[41]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[42]  Patric Jensfelt,et al.  A stochastically stable solution to the problem of robocentric mapping , 2009, 2009 IEEE International Conference on Robotics and Automation.

[43]  Frank Dellaert,et al.  Semantic Modeling of Places using Objects , 2007, Robotics: Science and Systems.

[44]  Henrik I. Christensen,et al.  The M-Space Feature Representation for SLAM , 2007, IEEE Transactions on Robotics.

[45]  A. Leonardis,et al.  A basic cognitive system for interactive continuous learning of visual concepts , 2010 .

[46]  Roland Siegwart,et al.  Cognitive maps for mobile robots - an object based approach , 2007, Robotics Auton. Syst..

[47]  José A. Castellanos,et al.  Robocentric map joining: Improving the consistency of EKF-SLAM , 2007, Robotics Auton. Syst..

[48]  Matthias Scheutz,et al.  Integrating a Closed World Planner with an Open World Robot: A Case Study , 2010, AAAI.

[49]  Inna Mikhailova,et al.  Expectation-driven autonomous learning and interaction system , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[50]  Subbarao Kambhampati,et al.  Over-Subscription in Planning: a Partial Satisfaction Problem , 2004 .

[51]  Patric Jensfelt,et al.  Representing Spatial Knowledge in Mobile Cognitive Systems , 2010 .

[52]  Barbara Caputo,et al.  Multi-modal Semantic Place Classification , 2010, Int. J. Robotics Res..

[53]  Horst-Michael Groß,et al.  A vision architecture for unconstrained and incremental learning of multiple categories , 2009, Memetic Comput..

[54]  Nick Hawes,et al.  Crossmodal content binding in information-processing architectures , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[55]  Yisheng Dong,et al.  An active learning system for mining time-changing data streams , 2007, Intell. Data Anal..

[56]  Benjamin Kuipers,et al.  Local metrical and global topological maps in the hybrid spatial semantic hierarchy , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[57]  Trevor Darrell,et al.  Active Learning with Gaussian Processes for Object Categorization , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[58]  Matej Kristan Multivariate Online Kernel Density Estimation , 2010 .

[59]  Xiaodong Lin,et al.  Active Learning From Stream Data Using Optimal Weight Classifier Ensemble , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[60]  Roland Siegwart,et al.  Hybrid simultaneous localization and map building: a natural integration of topological and metric , 2003, Robotics Auton. Syst..

[61]  Matthias Scheutz,et al.  The Utility of Affect in the Selection of Actions and Goals Under Real-World Constraints , 2009, IC-AI.

[62]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[63]  Marc Hanheide,et al.  A Framework for Goal Generation and Management , 2010, AAAI 2010.

[64]  Luc Steels,et al.  Aibo''s first words. the social learning of language and meaning. Evolution of Communication , 2002 .

[65]  Shucheng Huang,et al.  An Active Learning Method for Mining Time-Changing Data Streams , 2008, 2008 Second International Symposium on Intelligent Information Technology Application.

[66]  SiegwartRoland,et al.  Cognitive maps for mobile robots-an object based approach , 2007 .

[67]  Vincent Lepetit,et al.  Fast Keypoint Recognition in Ten Lines of Code , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[68]  Wolfgang Wahlster,et al.  SmartKom: Foundations of Multimodal Dialogue Systems , 2006, SmartKom.

[69]  Danijel Skocaj,et al.  Multivariate online kernel density estimation with Gaussian kernels , 2011, Pattern Recognit..

[70]  Vincent Lepetit,et al.  Fast Keypoint Recognition Using Random Ferns , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[71]  Patric Jensfelt,et al.  Simultaneous object class and pose estimation for mobile robotic applications with minimalistic recognition , 2010, 2010 IEEE International Conference on Robotics and Automation.

[72]  Alexei Makarenko,et al.  Information based adaptive robotic exploration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[73]  A. Sloman,et al.  A Study of Motive Processing and Attention , 1993 .

[74]  Michael Wooldridge,et al.  Introduction to multiagent systems , 2001 .

[75]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[76]  Karen E. Lochbaum,et al.  A Collaborative Planning Model of Intentional Structure , 1998, CL.