A discrete computational model of sensorimotor contingencies for object perception and control of behavior

According to Sensorimotor Contingency Theory (SCT), visual awareness in humans emerges from the specific properties of the relation between the actions an agent performs on an object and the resulting changes in sensory stimulation. The main consequence of this approach is that perception is based not only on information coming from the sensory system, but requires knowledge about the actions that caused this input. For the development of autonomous artificial agents the conclusion is that consideration of the actions, that cause changes in sensory measurements, could result in a more human-like performance in object recognition and manipulation than ever more sophisticated analyses of the sensory signal in isolation, an approach that has not been fully explored yet. We present the first results of a modeling study elucidating computational mechanisms implied by adopting SCT for robot control, and demonstrate the concept in two artificial agents. The model is given in abstract, probabilistic terms that lead to straightforward implementations on a computer, but also allow for a neurophysiological grounding. After demonstrating the emergence of object-following behavior in a computer simulation of the model, we present results on object perception in a real robot controlled by the model. We show how the model accounts for aspects of the robot's embodiment, and discuss the role of memory, behavior, and value systems with respect to SCT as a cognitive control architecture.

[1]  Pierre-Yves Oudeyer,et al.  Intrinsic Motivation Systems for Autonomous Mental Development , 2007, IEEE Transactions on Evolutionary Computation.

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  Ales Ude,et al.  Perceiving Objects and Movements to Generate Actions on a Humanoid Robot , 2008 .

[4]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[5]  Siddhartha S. Srinivasa,et al.  Object recognition and full pose registration from a single image for robotic manipulation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[6]  Philippe Gaussier,et al.  Perception as a Dynamical Sensori-Motor Attraction Basin , 2005, ECAL.

[7]  Heiko Hoffmann,et al.  Perception through visuomotor anticipation in a mobile robot , 2007, Neural Networks.

[8]  M. Rohde,et al.  Horizons for the Enactive Mind: Values, Social Interaction, and Play , 2010 .

[9]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[10]  Daniel Chern-Yeow Eng,et al.  Autonomous Learning of the Semantics of Internal Sensory States Based on Motor Exploration , 2007, Int. J. Humanoid Robotics.

[11]  Rolf Pfeifer,et al.  Emergence of delayed reward learning from sensorimotor coordination , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Eduardo Izquierdo-Torres,et al.  Adapting to Your Body , 2007, ECAL.

[13]  Laurenz Wiskott,et al.  Is slowness a learning principle of the visual cortex? , 2003, Zoology.

[14]  Olaf Sporns,et al.  Mapping Information Flow in Sensorimotor Networks , 2006, PLoS Comput. Biol..