Internal simulation of perception: a minimal neuro-robotic model

This paper explores the possibility of providing robots with an 'inner world' based on internal simulation of perception rather than an explicit representational world model. First a series of initial experiments is discussed, in which recurrent neural networks were evolved to control collision-free corridor following behavior in a simulated Khepera robot and predict the next time step's sensory input as accurately as possible. Attempts to let the robot act blindly, i.e. repeatedly using its own prediction instead of the real sensory input, were not particularly successful. This motivated the second series of experiments, on which this paper focuses. A feed-forward network was used which, as above, controlled behavior and predicted sensory input. However, weight evolution was now guided by the sole fitness criterion of successful, 'blindfolded' corridor following behavior, including timely turns, as above using as input only own sensory predictions rather than actual sensory input. The trained robot is in some cases actually able to move blindly in a simple environment for hundreds of time steps, successfully handling several multi-step turns. Somewhat surprisingly, however, it does so based on self-generated input that is not particularly similar to the actual sensory values.

[1]  Stefano Nolfi,et al.  Evolving mobile robots in simulated and real environments , 1995 .

[2]  Markus F. Peschl,et al.  The Representational Relation Between Environmental Structures and Neural Systems: Autonomy and Environmental Dependency in Neural Knowledge Representation , 1997 .

[3]  Francesco Mondada,et al.  Evolution of homing navigation in a real mobile robot , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[4]  Andy Clark,et al.  Towards a Cognitive Robotics , 1999, Adapt. Behav..

[5]  Stefano Nolfi,et al.  Learning to perceive the world as articulated: an approach for hierarchical learning in sensory-motor systems , 1998, Neural Networks.

[6]  Gary McGraw,et al.  Emergent Control and Planning in an Autonomous Vehicle , 1993 .

[7]  Rolf Pfeifer,et al.  Understanding intelligence , 2020, Inequality by Design.

[8]  Georg Dorffner Neural Networks and a New Artificial Intelligence , 1999 .

[9]  Lisa Meeden,et al.  An incremental approach to developing intelligent neural network controllers for robots , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[10]  Lucy Suchman Plans and situated actions: the problem of human-machine communication , 1987 .

[11]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[12]  Horst-Michael Groß,et al.  Generative character of perception: a neural architecture for sensorimotor anticipation , 1999, Neural Networks.

[13]  W. T. Thach What is the role of the cerebellum in motor learning and cognition? , 1998, Trends in Cognitive Sciences.

[14]  Tom Ziemke,et al.  Blind Adaptive Behavior Based on Internal Simulation of Perception , 2002 .

[15]  Aude Billard,et al.  From Animals to Animats , 2004 .

[16]  Stefano Nolfi,et al.  Extracting Regularities in Space and Time Through a Cascade of Prediction Networks: The Case of a Mobile Robot Navigating in a Structured Environment , 1999, Connect. Sci..

[17]  C. Campbell,et al.  On Being There , 1965 .

[18]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[19]  Marina Basu The Embodied Mind: Cognitive Science and Human Experience , 2004 .

[20]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[21]  P. Agre Lucy A. Suchman, Plans and Situated Actions: The Problem of Human-Machine Commuinication (Cambridge University Press, Cambridge 1987) , 1990, Artif. Intell..

[22]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[23]  Rick Grush,et al.  The architecture of representation , 1997 .

[24]  Stefano Nolfi,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , 2000 .

[25]  M. Jeannerod The representing brain: Neural correlates of motor intention and imagery , 1994, Behavioral and Brain Sciences.

[26]  T. Ziemke The Construction of ‘Reality’ in the Robot: Constructivist Perspectives on Situated Artificial Intelligence and Adaptive Robotics , 2001 .

[27]  M. Jeannerod,et al.  The cognitive neuroscience of mental imagery , 1995, Neuropsychologia.

[28]  Daniel M. Wolpert,et al.  Forward Models for Physiological Motor Control , 1996, Neural Networks.

[29]  Stefano Nolfi,et al.  Using Emergent Modularity to Develop Control Systems for Mobile Robots , 1997, Adapt. Behav..

[30]  R. Mansfield,et al.  Analysis of visual behavior , 1982 .

[31]  Rodney A. Brooks,et al.  Intelligence Without Reason , 1991, IJCAI.

[32]  G. Hesslow Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[33]  R. Miall,et al.  Sequences of sensory predictions , 1997, Behavioral and Brain Sciences.

[34]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[35]  G. Hesslow,et al.  Will neuroscience explain consciousness? , 1994, Journal of theoretical biology.

[36]  F. Linåker,et al.  Extraction and Inversion of Abstract Sensory Flow Representations , 2000 .

[37]  Francesco Mondada,et al.  Mobile Robot Miniaturisation: A Tool for Investigation in Control Algorithms , 1993, ISER.

[38]  Germund Hesslow,et al.  EXPLORING INTERNAL SIMULATION OF PERCEPTION IN MOBILE ROBOTS , 2001 .