Modelling mental rotation in cognitive robots

Mental rotation concerns the cognitive processes that allow an agent mentally to rotate the image of an object in order to solve a given task, for example to say if two objects with different orientations are the same or different. Here we present a system-level bio-constrained model, developed within a neurorobotics framework, that provides an embodied account of mental rotation processes relying on neural mechanisms involving motor affordance encoding, motor simulation and the anticipation of the sensory consequences of actions (both visual and proprioceptive). This model and methodology are in agreement with the most recent theoretical and empirical research on mental rotation. The model was validated through experiments with a simulated humanoid robot (iCub) engaged in solving a classical mental rotation test. The results of the test show that the robot is able to solve the task and, in agreement with data from psychology experiments, exhibits response times linearly dependent on the angular disparity between the objects. This model represents a novel detailed operational account of the embodied brain mechanisms that may underlie mental rotation.

[1]  T. Ziemke,et al.  Theories and computational models of affordance and mirror systems: An integrative review , 2013, Neuroscience & Biobehavioral Reviews.

[2]  A. Wohlschläger,et al.  Mental and manual rotation. , 1998, Journal of experimental psychology. Human perception and performance.

[3]  Angelo Cangelosi,et al.  An open-source simulator for cognitive robotics research: the prototype of the iCub humanoid robot simulator , 2008, PerMIS.

[4]  A. Cangelosi,et al.  How affordances associated with a distractor object affect compatibility effects: A study with the computational model TRoPICALS , 2013, Psychological research.

[5]  Fumiya Iida,et al.  50 Years of Artificial Intelligence, Essays Dedicated to the 50th Anniversary of Artificial Intelligence , 2007, 50 Years of Artificial Intelligence.

[6]  S. Kita,et al.  Spontaneous gestures during mental rotation tasks: insights into the microdevelopment of the motor strategy. , 2008, Journal of experimental psychology. General.

[7]  Daniele Caligiore,et al.  AFFORDANCES AND COMPATIBILITY EFFECTS: A NEURAL-NETWORK COMPUTATIONAL MODEL , 2009 .

[8]  Gianluca Baldassarre,et al.  Forward and Bidirectional Planning Based on Reinforcement Learning and Neural Networks in a Simulated Robot , 2003, ABiALS.

[9]  Claus Lamm,et al.  The functional role of dorso-lateral premotor cortex during mental rotation An event-related fMRI study separating cognitive processing steps using a novel task paradigm , 2007, NeuroImage.

[10]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[11]  Lawrence W. Barsalou,et al.  Language and simulation in conceptual processing , 2008 .

[12]  Gianluca Baldassarre,et al.  Planning with neural networks and reinforcement learning , 2001 .

[13]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[14]  Ravi S. Menon,et al.  Motor Area Activity During Mental Rotation Studied by Time-Resolved Single-Trial fMRI , 2000, Journal of Cognitive Neuroscience.

[15]  Giulio Sandini,et al.  The iCub Cognitive Humanoid Robot: An Open-System Research Platform for Enactive Cognition , 2006, 50 Years of Artificial Intelligence.

[16]  G. Logan.  The CODE theory of visual attention: an integration of space-based and object-based attention. , 1996, Psychological review.

[17]  J. T. Massey,et al.  Mental rotation of the neuronal population vector. , 1989, Science.

[18]  R. McLaren,et al.  Interaction between perceived and imagined rotation. , 1982, Journal of experimental psychology. Human perception and performance.

[19]  E. Oja.  Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[20]  Moritz M. Daum,et al.  Motor Processes in Children's Mental Rotation , 2009 .

[21]  Scott T. Grafton,et al.  Premotor Cortex Activation during Observation and Naming of Familiar Tools , 1997, NeuroImage.

[22]  J. Fuster.  The Prefrontal Cortex—An Update Time Is of the Essence , 2001, Neuron.

[23]  R. Miall,et al.  Connecting mirror neurons and forward models. , 2003, Neuroreport.

[24]  G. Baldassarre,et al.  Learning to select targets within targets in reaching tasks , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[25]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[26]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[27]  G. Rizzolatti,et al.  The mirror-neuron system. , 2004, Annual review of neuroscience.

[28]  D M Wolpert,et al.  Multiple paired forward and inverse models for motor control , 1998, Neural Networks.

[29]  R. Ellis,et al.  The potentiation of grasp types during visual object categorization , 2001 .

[30]  J. Reddy,et al.  THEORIES AND COMPUTATIONAL MODELS FOR COMPOSITE LAMINATES , 1994 .

[31]  E. Naito,et al.  Visuokinesthetic Perception of Hand Movement is Mediated by Cerebro–Cerebellar Interaction between the Left Cerebellum and Right Parietal Cortex , 2008, Cerebral cortex.

[32]  Susan Goldin.  Hearing gesture : how our hands help us think , 2003 .

[33]  K. Doya.  Complementary roles of basal ganglia and cerebellum in learning and motor control , 2000, Current Opinion in Neurobiology.

[34]  Angelo Rega,et al.  A Model of Reaching that Integrates Reinforcement Learning and Population Encoding of Postures , 2006, SAB.

[35]  P. Brugger,et al.  Motor processes in children's imagery: the case of mental rotation of hands. , 2005, Developmental science.

[36]  S. Kosslyn.  Image and Brain: The Resolution of the Imagery Debate , 1994, Journal of Cognitive Neuroscience.

[37]  A. Wohlschläger.  Mental object rotation and the planning of hand movements , 2001, Perception & psychophysics.

[38]  S. Kita,et al.  The nature of gestures ' beneficial role in spatial problem solving , 2013 .

[39]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[40]  G. Pezzulo,et al.  When affordances climb into your mind: Advantages of motor simulation in a memory task performed by novice and expert rock climbers , 2010, Brain and Cognition.

[41]  Michael A. Arbib,et al.  Modeling parietal-premotor interactions in primate control of grasping , 1998, Neural Networks.

[42]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[43]  D. Parisi,et al.  TRoPICALS: a computational embodied neuroscience model of compatibility effects. , 2010, Psychological review.

[44]  Domenico Parisi,et al.  Using Motor Babbling and Hebb Rules for Modeling the Development of Reaching with Obstacles and Grasping , 2008 .

[45]  Sir G. Archaeopteryx.  Object-based attention in the primary visual cortex of the macaque monkey , 1998 .

[46]  Bernhard Hommel,et al.  Mental rotation impairs attention shifting and short-term memory encoding: Neurophysiological evidence against the response-selection bottleneck model of dual-task performance , 2011, Neuropsychologia.

[47]  R. Ellis,et al.  Action priming by briefly presented objects. , 2004, Acta psychologica.

[48]  J. Decety,et al.  Functional anatomy of execution, mental simulation, observation, and verb generation of actions: A meta‐analysis , 2001, Human brain mapping.

[49]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Claus Lamm,et al.  Individual differences in brain activity during visuo-spatial processing assessed by slow cortical potentials and LORETA. , 2005, Brain research. Cognitive brain research.

[51]  G. Schöner,et al.  Dynamic Field Theory of Movement Preparation , 2022 .

[52]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[53]  H. Krist,et al.  Imagery and Motor Processes — When Are They Connected? The Mental Rotation of Body Parts in Development , 2009 .

[54]  J. Pellegrino,et al.  Developmental changes in mental rotation. , 1980, Journal of experimental child psychology.

[55]  Teuvo Kohonen,et al.  Self-Organizing Maps, Second Edition , 1997, Springer Series in Information Sciences.

[56]  S. Kosslyn,et al.  Motor processes in mental rotation , 1998, Cognition.