Vision-sensorimotor abstraction and imagination towards exploring robot’s inner world

Based on indications from the neuroscience and psychology, both perception and action can be internally simulated by activating sensor and motor areas in the brain without external sensory input or without any resulting overt behavior. This hypothesis, however, can be highly useful in the real robot applications. The robot, for instance, can cover some of the corrupted sensory inputs by replacing them with its internal simulation. The accuracy of this hypothesis is strongly based on the agentpsilas experiences. As much as the agent knows about the environment, as much as it can build a strong internal representation about it. Although many works have been presented regarding to this hypothesis with various levels of success. At the sensorimotor abstraction level, where extracting data from the environment occur, however, none of them have so far used the robotpsilas vision as a sensory input. In this study, vision-sensorimotor abstraction is presented through memory-based learning in a real mobile robot ldquoHemissonrdquo to investigate the possibilities of explaining its inner world based on internal simulation of perception and action at the abstract level. The analysis of the experiments illustrate that our robot with vision sensory input has developed some kind of simple associations or anticipation mechanism through interacting with the environment, which enables, based on its history and the present situation, to guide its behavior in the absence of any external interaction.

[1]  G. Hesslow,et al.  Will neuroscience explain consciousness? , 1994, Journal of theoretical biology.

[2]  John Stening,et al.  Exploring Internal Simulations of Perception in a Mobile Robot using Abstractions , 2004 .

[3]  F. Linåker,et al.  Extraction and Inversion of Abstract Sensory Flow Representations , 2000 .

[4]  Stefano Nolfi,et al.  Extracting Regularities in Space and Time Through a Cascade of Prediction Networks: The Case of a Mobile Robot Navigating in a Structured Environment , 1999, Connect. Sci..

[5]  S. Schaal,et al.  Robot juggling: implementation of memory-based learning , 1994, IEEE Control Systems.

[6]  Tracy Brown,et al.  The Embodied Mind: Cognitive Science and Human Experience , 2002, Cybern. Hum. Knowing.

[7]  Tom Ziemke,et al.  Imagination and Abstraction of Sensorimotor Flow : Towards a Robot Model , 2005 .

[8]  Lars Niklasson,et al.  Time series segmentation using an adaptive resource allocating vector quantization network based on change detection , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[9]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[10]  Germund Hesslow,et al.  EXPLORING INTERNAL SIMULATION OF PERCEPTION IN MOBILE ROBOTS , 2001 .

[11]  Kazuyuki Murase,et al.  A Spiking Neural Network with dynamic memory for a real autonomous mobile robot in dynamic environment , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[12]  G. Hesslow Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[13]  Kazuyuki Murase,et al.  Self-organization of Spiking Neural Network that Generates Autonomous Behavior in a Real Mobile Robot , 2006, Int. J. Neural Syst..

[14]  Aude Billard,et al.  Action Selection and Mental Transformation Based on a Chain of Forward Models , 2004 .

[15]  Tom Ziemke,et al.  Blind Adaptive Behavior Based on Internal Simulation of Perception , 2002 .

[16]  Andy Clark,et al.  Towards a Cognitive Robotics , 1999, Adapt. Behav..

[17]  Tom Ziemke,et al.  Internal simulation of perception: a minimal neuro-robotic model , 2005, Neurocomputing.

[18]  Heiko Hoffmann,et al.  Action selection and mental transformation based on a chain of forward models , 2004 .