Dreaming of electric sheep? Exploring the functions of dream-like mechanisms in the development of mental imagery simulations

According to the simulation hypothesis, mental imagery can be explained in terms of predictive chains of simulated perceptions and actions, i.e., perceptions and actions are reactivated internally by our nervous system to be used in mental imagery and other cognitive phenomena. Our previous research shows that it is possible but not trivial to develop simulations in robots based on the simulation hypothesis. While there are several previous approaches to modelling mental imagery and related cognitive abilities, the origin of such internal simulations has hardly been addressed. The inception of simulation (InSim) hypothesis suggests that dreaming has a function in the development of simulations by forming associations between experienced, non-experienced but realistic, and even unrealistic perceptions. Here, we therefore develop an experimental set-up based on a simple simulated robot to test whether such dream-like mechanisms can be used to instruct research into the development of simulations and mental imagery-like abilities. Specifically, the hypothesis is that ‘dreams’ informing the construction of simulations lead to faster development of good simulations during waking behaviour. The paper presents initial results in favour of the hypothesis.

[1]  Samuel T. Moulton,et al.  Imagining predictions: mental imagery as mental emulation , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  S M Kosslyn,et al.  Visual images preserve metric spatial information: evidence from studies of image scanning. , 1978, Journal of experimental psychology. Human perception and performance.

[3]  Rolf A. Zwaan.  The Immersed Experiencer: Toward An Embodied Theory Of Language Comprehension , 2003 .

[4]  Tom Ziemke,et al.  Internal simulation of perception: a minimal neuro-robotic model , 2005, Neurocomputing.

[5]  Heiko Hoffmann,et al.  Action selection and mental transformation based on a chain of forward models , 2004 .

[6]  Heiko Homann,et al.  Perception through Visuomotor Anticipation in a Mobile Robot , 2006 .

[7]  J. Fuster.  Upper processing stages of the perception–action cycle , 2004, Trends in Cognitive Sciences.

[8]  Noam Chomsky,et al.  Language and Mind , 1973 .

[9]  G. Hesslow.  Conscious thought as simulation of behaviour and perception , 2002, Trends in Cognitive Sciences.

[10]  Peter Redgrave,et al.  Basal Ganglia , 2020, Encyclopedia of Autism Spectrum Disorders.

[11]  G. William Domhoff,et al.  A New Neurocognitive Theory of Dreams , 2001 .

[12]  Owen Holland,et al.  Robots With Internal Models A Route to Machine Consciousness , 2003 .

[13]  Gianluca Baldassarre.  Coarse planning for landmark navigation in a neural-network reinforcement-learning robot , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[14]  S. H. Johnson,et al.  Thinking ahead: the case for motor imagery in prospective judgements of prehension , 2000, Cognition.

[15]  E. Glasersfeld.  Radical Constructivism: A Way of Knowing and Learning. Studies in Mathematics Education Series: 6. , 1995 .

[16]  Tom Ziemke,et al.  Representation as Internal Simulation: A Minimalistic Robotic Model , 2009 .

[17]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[18]  J. Hobson,et al.  REM sleep and dreaming: towards a theory of protoconsciousness , 2009, Nature Reviews Neuroscience.

[19]  H. Roffwarg,et al.  Ontogenetic development of the human sleep-dream cycle. , 1966, Science.

[20]  A. Revonsuo.  The reinterpretation of dreams: an evolutionary hypothesis of the function of dreaming. , 2000, The Behavioral and brain sciences.

[21]  Wilfried Kunde,et al.  No anticipation–no action: the role of anticipation in action and perception , 2007, Cognitive Processing.

[22]  C. Windischberger,et al.  Evidence for Premotor Cortex Activity during Dynamic Visuospatial Imagery from Single-Trial Functional Magnetic Resonance Imaging and Event-Related Slow Cortical Potentials , 2001, NeuroImage.

[23]  R. Möller.  Perception Through Anticipation - A Behavior-Based Approach to Visual Perception , 1999 .

[24]  S. Kosslyn,et al.  Mental Imagery of High- and Low-Resolution Gratings Activates Area 17 , 2001, NeuroImage.

[25]  Keith L. Downing,et al.  Predictive models in the brain , 2009, Connect. Sci..

[26]  Rick Grush,et al.  The emulation theory of representation: Motor control, imagery, and perception , 2004, Behavioral and Brain Sciences.

[27]  Tom Ziemke,et al.  Neural Pathways of Embodied Simulation , 2009, ABiALS.

[28]  M. Jeannerod.  The representing brain: Neural correlates of motor intention and imagery , 1994, Behavioral and Brain Sciences.

[29]  S. Kosslyn,et al.  Neural foundations of imagery , 2001, Nature Reviews Neuroscience.

[30]  Glasersfeld E. von.  Distinguishing the observer: An attempt at interpreting Maturana , 1990 .

[31]  Germund Hesslow,et al.  Cerebellum and conditioned reflexes , 1998, Trends in Cognitive Sciences.

[32]  Jun Tani,et al.  Model-based learning for mobile robot navigation from the dynamical systems perspective , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[33]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[34]  Luciano Molinari,et al.  Sleep duration from infancy to adolescence: reference values and generational trends. , 2003, Pediatrics.

[35]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[36]  Alessio Toraldo,et al.  Dissociation between the mental rotation of visual images and motor images in unilateral brain-damaged patients , 2003, Brain and Cognition.

[37]  Floris P. de Lange,et al.  Motor Imagery in Mental Rotation: An fMRI Study , 2002, NeuroImage.

[38]  R. Moller,et al.  Perception through anticipation , 1994, Proceedings of PerAc '94. From Perception to Action.

[39]  M Jeannerod,et al.  Central activation of autonomic effectors during mental simulation of motor actions in man. , 1993, The Journal of physiology.

[40]  Francis Crick,et al.  REM sleep and neural nets , 1995, Behavioural Brain Research.

[41]  Stefano Nolfi,et al.  Learning to perceive the world as articulated: an approach for hierarchical learning in sensory-motor systems , 1998, Neural Networks.

[42]  G. Baldassarre.  A biologically plausible model of human planning based on neural networks and Dyna-PI models , 2002 .

[43]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[44]  Samuel Wintermute,et al.  Imagery in cognitive architecture: Representation and control at multiple levels of abstraction , 2012, Cognitive Systems Research.

[45]  A. Riegler,et al.  Understanding Representation in the Cognitive Sciences , 1999, Springer US.

[46]  M. Solms.  Dreaming and REM sleep are controlled by different brain mechanisms , 2000, Behavioral and Brain Sciences.

[47]  T. Ziemke,et al.  Embodied representation : What are the issues , 2005 .

[48]  Katherine Finn Davis,et al.  Sleep in infants and young children: Part one: normal sleep. , 2004, Journal of pediatric health care : official publication of National Association of Pediatric Nurse Associates & Practitioners.

[49]  M. Jeannerod.  Mental imagery in the motor context , 1995, Neuropsychologia.

[50]  Germund Hesslow,et al.  EXPLORING INTERNAL SIMULATION OF PERCEPTION IN MOBILE ROBOTS , 2001 .

[51]  R S Blacher.  To sleep, perchance to dream. , 1979, JAMA.

[52]  T. Ziemke,et al.  Theories and computational models of affordance and mirror systems: An integrative review , 2013, Neuroscience & Biobehavioral Reviews.

[53]  R. Finke,et al.  Principles of mental imagery , 1989 .

[54]  Owen Holland,et al.  Architectures for functional imagination , 2009, Neurocomputing.

[55]  A. Bastian.  Learning to predict the future: the cerebellum adapts feedforward movement control , 2006, Current Opinion in Neurobiology.

[56]  J. Hobson,et al.  The cognitive neuroscience of sleep: neuronal systems, consciousness and learning , 2002, Nature Reviews Neuroscience.

[57]  V. Braitenberg.  Vehicles, Experiments in Synthetic Psychology , 1984 .

[58]  F. Turkheimer,et al.  Emergence of resting state networks in the preterm human brain , 2010, Proceedings of the National Academy of Sciences.

[59]  M. Jeannerod,et al.  Mentally simulated movements in virtual reality: does Fitt's law hold in motor imagery? , 1995, Behavioural Brain Research.

[60]  M. Gazzaniga,et al.  The new cognitive neurosciences , 2000 .

[61]  Garrett E. Alexander.  Basal ganglia , 1998 .

[62]  M. Blumberg.  Beyond Dreams: Do Sleep-Related Movements Contribute to Brain Development? , 2010, Front. Neur..

[63]  Keith L. Downing,et al.  Neuroscientific implications for situated and embodied artificial intelligence , 2007, Connect. Sci..

[64]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[65]  Ron Chrisley,et al.  Cognitive Map Construction and Use: A Parallel Distributed Processing Approach , 1991 .

[66]  Mark H. Bickhard,et al.  Robots and representations , 1998 .

[67]  P. Dechent,et al.  Is the human primary motor cortex involved in motor imagery? , 2004, Brain research. Cognitive brain research.

[68]  Marco Schieppati,et al.  Imagined and actual arm movements have similar durations when performed under different conditions of direction and mass , 2002, Experimental Brain Research.

[69]  G William Domhoff,et al.  The neural substrate for dreaming: is it a subsystem of the default network? , 2011, Consciousness and cognition.

[70]  David S. Touretzky,et al.  Connectionist models : proceedings of the 1990 summer school , 1991 .

[71]  C Collet,et al.  Duration of Mentally Simulated Movement: A Review , 2005, Journal of motor behavior.

[72]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[73]  M D Humphries,et al.  The role of intra-thalamic and thalamocortical circuits in action selection , 2002, Network.

[74]  Tom Ziemke,et al.  Clarifying Embodied Cognition : SimulationTheories of Shared Neural Mechanisms used Sensorimotor and Cognitive Processes , 2007 .

[75]  M. Jeannerod,et al.  The timing of mentally represented actions , 1989, Behavioural Brain Research.

[76]  J. Decety,et al.  Functional anatomy of execution, mental simulation, observation, and verb generation of actions: A meta‐analysis , 2001, Human brain mapping.

[77]  D. Dennett.  Kinds of Minds: Towards an Understanding of Consciousness , 1996 .

[78]  D. Ingvar,et al.  Distribution of cerebral blood flow in the dominant hemisphere during motor ideation and motor performance , 1977, Annals of neurology.

[79]  Michael L. Anderson.  Neural reuse: A fundamental organizational principle of the brain , 2010, Behavioral and Brain Sciences.

[80]  M. Jeannerod,et al.  Mental imaging of motor activity in humans , 1999, Current Opinion in Neurobiology.

[81]  R. Cotterill.  Cooperation of the basal ganglia, cerebellum, sensory cerebrum and hippocampus: possible implications for cognition, consciousness, intelligence and creativity , 2001, Progress in Neurobiology.

[82]  M. Goodale.  Image and Brain: The Resolution of the Imagery Debate , 1995 .

[83]  G. Hesslow.  The current status of the simulation theory of cognition , 2012, Brain Research.

[84]  Martin V. Butz,et al.  Anticipatory Behavior in Adaptive Learning Systems , 2003, Lecture Notes in Computer Science.

[85]  Tom Ziemke,et al.  Imagination and Abstraction of Sensorimotor Flow : Towards a Robot Model , 2005 .

[86]  G. Hesslow,et al.  Will neuroscience explain consciousness? , 1994, Journal of theoretical biology.

[87]  Horst-Michael Groß,et al.  Generative character of perception: a neural architecture for sensorimotor anticipation , 1999, Neural Networks.

[88]  M. Jeannerod.  Neural Simulation of Action: A Unifying Mechanism for Motor Cognition , 2001, NeuroImage.

[89]  D. Wolpert,et al.  Why can't you tickle yourself? , 2000, Neuroreport.

[90]  Angelo Cangelosi,et al.  The Mechanics of Embodiment: A Dialog on Embodiment and Computational Modeling , 2011, Front. Psychology.

[91]  R. Stickgold,et al.  Dreaming and the brain: Toward a cognitive neuroscience of conscious states , 2000, Behavioral and Brain Sciences.

[92]  Bartlett W. Mel.  A Connectionist Model May Shed Light on Neural Mechanisms for Visually Guided Reaching , 1991, Journal of Cognitive Neuroscience.

[93]  Kazuo Hiraki,et al.  From Egocentric to Allocentric Spatial Behavior: A Computational Model of Spatial Development , 1998, Adapt. Behav..

[94]  Stefano Nolfi,et al.  Extracting Regularities in Space and Time Through a Cascade of Prediction Networks: The Case of a Mobile Robot Navigating in a Structured Environment , 1999, Connect. Sci..

[95]  Nigel J. T. Thomas.  Are theories of imagery theories of imagination?: An active perception approach to conscious mental content , 1999 .

[96]  Serge Thill,et al.  The inception of simulation: a hypothesis for the role of dreams in young children , 2011, CogSci.

[97]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[98]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[99]  Christoph Adami,et al.  What Do Robots Dream Of? , 2006, Science.