Space dimension perception from the multimodal sensorimotor flow of a naive robotic agent

Perception and action are fundamental tasks for autonomous robots. Traditionnally, they rely on theoretical models built by the system's designer. But, is a naive agent able to learn by itself the structure of its interaction with the environment without any a priori information ? This knowledge should be extracted through the analysis of the only information it has access to: its high-dimensional sensorimotor flow. Recent works, based on the sensorimotor contingencies theory, allow a simulated agent to extract the geometrical space dimensionality without any model of itself nor of the environment. In this paper, these results are validated using a more sophisticated auditive modality. The question of multimodality fusion is then addressed by fitting up the agent with vision. Finally, preliminary experimental results on a real robotic platform are presented.

[1]  T. R. Garrett,et al.  Normal range of motion of the cervical spine: an initial goniometric study. , 1992, Physical therapy.

[2]  Michel Verleysen,et al.  Nonlinear Dimensionality Reduction , 2021, Computer Vision.

[3]  Jochen Triesch,et al.  Rules for information maximization in spiking neurons using intrinsic plasticity , 2009, 2009 International Joint Conference on Neural Networks.

[4]  R. Held,et al.  MOVEMENT-PRODUCED STIMULATION IN THE DEVELOPMENT OF VISUALLY GUIDED BEHAVIOR. , 1963, Journal of comparative and physiological psychology.

[5]  J. Kevin O'Regan,et al.  Is There Something Out There? Inferring Space from Sensorimotor Dependencies , 2003, Neural Computation.

[6]  Raj S. Sodhi Evaluation of head and neck motion with the hemispherical shell method , 2000 .

[7]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[8]  R. Patterson,et al.  Complex Sounds and Auditory Images , 1992 .

[9]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[10]  J. Kevin O'Regan,et al.  Perception of the Structure of the Physical World Using Unknown Multimodal Sensors and Effectors , 2003, NIPS.

[11]  Roy D. Patterson,et al.  A FUNCTIONAL MODEL OF NEURAL ACTIVITY PATTERNS AND AUDITORY IMAGES , 2004 .

[12]  A. Berthoz,et al.  Le sens du mouvement , 1997 .

[13]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[14]  Bruno Gas,et al.  Extracting space dimension information from the auditory modality sensori-motor flow using a bio-inspired model of the cochlea , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  David Philipona Développement d'un cadre mathématique pour une théorie sensorimotrice de l'expérience sensorielle , 2008 .