Virtual reality and consciousness inference in dreaming

This article explores the notion that the brain is genetically endowed with an innate virtual reality generator that – through experience-dependent plasticity – becomes a generative or predictive model of the world. This model, which is most clearly revealed in rapid eye movement (REM) sleep dreaming, may provide the theater for conscious experience. Functional neuroimaging evidence for brain activations that are time-locked to rapid eye movements (REMs) endorses the view that waking consciousness emerges from REM sleep – and dreaming lays the foundations for waking perception. In this view, the brain is equipped with a virtual model of the world that generates predictions of its sensations. This model is continually updated and entrained by sensory prediction errors in wakefulness to ensure veridical perception, but not in dreaming. In contrast, dreaming plays an essential role in maintaining and enhancing the capacity to model the world by minimizing model complexity and thereby maximizing both statistical and thermodynamic efficiency. This perspective suggests that consciousness corresponds to the embodied process of inference, realized through the generation of virtual realities (in both sleep and wakefulness). In short, our premise or hypothesis is that the waking brain engages with the world to predict the causes of sensations, while in sleep the brain’s generative model is actively refined so that it generates more efficient predictions during waking. We review the evidence in support of this hypothesis – evidence that grounds consciousness in biophysical computations whose neuronal and neurochemical infrastructure has been disclosed by sleep research.

[1]  Matthew J. Beal Variational algorithms for approximate Bayesian inference , 2003 .

[2]  N. Kleitman,et al.  Regularly occurring periods of eye motility, and concomitant phenomena, during sleep. , 1953, Science.

[3]  Karl J. Friston,et al.  Perceptions as Hypotheses: Saccades as Experiments , 2012, Front. Psychology.

[4]  J. Hobson,et al.  A New Paradigm for Dream Research: Mentation Reports Following Spontaneous Arousal from REM and NREM Sleep Recorded in a Home Setting , 1994, Consciousness and Cognition.

[5]  M. Jouvet,et al.  Biogenic amines and the states of sleep. , 1969, Science.

[6]  J. Born,et al.  The memory function of sleep , 2010, Nature Reviews Neuroscience.

[7]  Christoph Kayser,et al.  Unimodal Responses Prevail within the Multisensory Claustrum , 2010, The Journal of Neuroscience.

[8]  T. Womelsdorf,et al.  Neuronal coherence during selective attentional processing and sensory–motor integration , 2006, Journal of Physiology-Paris.

[9]  J. Hobson,et al.  Constraint on the Transformation of Characters, Objects, and Settings in Dream Reports , 1994, Consciousness and Cognition.

[10]  Miles A Whittington,et al.  A beta2-frequency (20–30 Hz) oscillation in nonsynaptic networks of somatosensory cortex , 2006, Proceedings of the National Academy of Sciences.

[11]  J. Yordanova,et al.  Brain Oscillations and Predictive Processing , 2012, Front. Psychology.

[12]  S. Laberge,et al.  Dreaming and waking: Similarities and differences revisited , 2011, Consciousness and Cognition.

[13]  Karl J. Friston Hierarchical Models in the Brain , 2008, PLoS Comput. Biol..

[14]  Shin Ishii,et al.  Bayesian representation learning in the cortex regulated by acetylcholine , 2004, Neural Networks.

[15]  Itzhak Fried,et al.  Large-Scale Microelectrode Recordings of High-Frequency Gamma Oscillations in Human Cortex during Sleep , 2010, The Journal of Neuroscience.

[16]  B M Dow,et al.  REM sleep eye movement counts correlate with visual imagery in dreaming: a pilot study. , 1997, Psychophysiology.

[17]  V. Noreika,et al.  How to integrate dreaming into a general theory of consciousness—A critical review of existing positions and suggestions for future research , 2011, Consciousness and Cognition.

[18]  Satoru Miyauchi,et al.  Connectivity pattern changes in default-mode network with deep non-REM and REM sleep , 2011, Neuroscience Research.

[19]  D. Chalmers The conscious mind: in search of a fundamental theory , 1996 .

[20]  Cameron Buckner The Ego Tunnel: The Science of Mind and the Myth of the Self , 2012 .

[21]  K. Christoff,et al.  Experience sampling during fMRI reveals default network and executive system contributions to mind wandering , 2009, Proceedings of the National Academy of Sciences.

[22]  Karl J. Friston,et al.  Comparing dynamic causal models , 2004, NeuroImage.

[23]  Geoffrey E. Hinton,et al.  Keeping Neural Networks Simple , 1993 .

[24]  Karl J. Friston,et al.  Predictions not commands: active inference in the motor system , 2012, Brain Structure and Function.

[25]  Robert T. Knight,et al.  Superior Temporal SulcusIt's My Area: Or Is It? , 2008, Journal of Cognitive Neuroscience.

[26]  Geoffrey E. Hinton,et al.  Keeping the neural networks simple by minimizing the description length of the weights , 1993, COLT '93.

[27]  Thomas Metzinger,et al.  Why are dreams interesting for philosophers? The example of minimal phenomenal selfhood, plus an agenda for future research1 , 2013, Front. Psychol..

[28]  Karl J. Friston,et al.  The Relationship Between Synchronization Among Neuronal Populations and Their Mean Activity Levels , 1999, Neural Computation.

[29]  J. Hobson,et al.  REM sleep burst neurons, PGO waves, and eye movement information. , 1983, Journal of neurophysiology.

[30]  J. Hobson,et al.  Self-organization theory of dreaming. , 1993 .

[31]  Giorgio F. Gilestro,et al.  Widespread Changes in Synaptic Markers as a Function of Sleep and Wakefulness in Drosophila , 2009, Science.

[32]  M. Mesulam,et al.  The cholinergic innervation of the human cerebral cortex. , 2004, Progress in brain research.

[33]  K. D. Zylan,et al.  Article , 1996, Physiology & Behavior.

[34]  J. Hobson,et al.  State-dependent thinking: A comparison of waking and dreaming thought , 2005, Consciousness and Cognition.

[35]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[36]  刘金明,et al.  IL-13受体α2降低血吸虫病肉芽肿的炎症反应并延长宿主存活时间[英]/Mentink-Kane MM,Cheever AW,Thompson RW,et al//Proc Natl Acad Sci U S A , 2005 .

[37]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[38]  M. Schredl Dream content analysis: Basic principles , 2010 .

[39]  M. Jouvet,et al.  [Research on the neural structures and responsible mechanisms in different phases of physiological sleep]. , 1962, Archives italiennes de biologie.

[40]  Dream formation during an epileptic seizure: implications for the study of the "unconscious". , 1977, The Journal of the American Academy of Psychoanalysis.

[41]  Karl J. Friston,et al.  Attention, Uncertainty, and Free-Energy , 2010, Front. Hum. Neurosci..

[42]  B. Dow,et al.  Localized and lateralized cerebral glucose metabolism associated with eye movements during REM sleep and wakefulness: a positron emission tomography (PET) study. , 1995, Sleep.

[43]  A. Braun,et al.  Regional cerebral blood flow throughout the sleep-wake cycle. An H2(15)O PET study. , 1997, Brain : a journal of neurology.

[44]  W. Jordan A New Paradigm , 1991, Restoration & Management Notes.

[45]  Karl J. Friston,et al.  Consciousness, Dreams, and Inference The Cartesian Theatre Revisited , 2014 .

[46]  C. Koch,et al.  What is the function of the claustrum? , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[47]  Hellmuth Obrig,et al.  Neural correlates of dream lucidity obtained from contrasting lucid versus non-lucid REM sleep: a combined EEG/fMRI case study. , 2012, Sleep.

[48]  C. Hall,et al.  The content analysis of dreams , 1966 .

[49]  F. Gregory The conscious mind: In search of a fundamental theory , 1998 .

[50]  J. L. Cantero,et al.  Decay time of the auditory sensory memory trace during wakefulness and REM sleep. , 2000, Psychophysiology.

[51]  S. Potkin,et al.  Language in dreaming and regional EEG alpha power. , 1996, Sleep.

[52]  R. Gregory Perceptions as hypotheses. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[53]  W. Bechtel,et al.  Multiple Realizability Revisited: Linking Cognitive and Neural States , 1999, Philosophy of Science.

[54]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[55]  R. Cartwright The Twenty-four Hour Mind: The Role of Sleep and Dreaming in Our Emotional Lives , 2010 .

[56]  Vladimir López,et al.  ERPs studies of cognitive processing during sleep. , 2009, International journal of psychology : Journal international de psychologie.

[57]  H. Roffwarg,et al.  Rapid eye movement sleep deprivation modifies expression of long-term potentiation in visual cortex of immature rats , 2002, Neuroscience.

[58]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[59]  A. Rechtschaffen,et al.  Sleep deprivation in the rat: X. Integration and discussion of the findings. , 2002, Sleep.

[60]  Karl J. Friston,et al.  A Bayesian account of ‘hysteria’ , 2012, Brain : a journal of neurology.

[61]  Geoffrey E. Hinton,et al.  The Helmholtz Machine , 1995, Neural Computation.

[62]  Karl J. Friston,et al.  Active inference, sensory attenuation and illusions , 2013, Cognitive Processing.

[63]  R Szymusiak,et al.  Magnocellular nuclei of the basal forebrain: substrates of sleep and arousal regulation. , 1995, Sleep.

[64]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[65]  O. Blanke Multisensory brain mechanisms of bodily self-consciousness , 2012, Nature Reviews Neuroscience.

[66]  F. Crick Function of the thalamic reticular complex: the searchlight hypothesis. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[67]  Lisa M. Giocomo,et al.  Cholinergic modulation of cortical function , 2007, Journal of Molecular Neuroscience.

[68]  Karl J. Friston,et al.  Smooth Pursuit and Visual Occlusion: Active Inference and Oculomotor Control in Schizophrenia , 2012, PloS one.

[69]  H. Roffwarg,et al.  Ontogenetic development of the human sleep-dream cycle. , 1966, Science.

[70]  R. Llinás,et al.  Coherent 40-Hz oscillation characterizes dream state in humans. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[71]  G. E. Smith The Human Brain , 1924, Nature.

[72]  W. Singer,et al.  Temporal binding and the neural correlates of sensory awareness , 2001, Trends in Cognitive Sciences.

[73]  Geoffrey E. Hinton,et al.  The "wake-sleep" algorithm for unsupervised neural networks. , 1995, Science.

[74]  J. Gotman,et al.  Correlation of high-frequency oscillations with the sleep–wake cycle and cognitive activity in humans , 1999, Neuroscience.

[75]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[76]  M. Jouvet,et al.  [POLYGRAPHIC STUDY OF SLEEP IN BIRDS]. , 1964, Comptes rendus des seances de la Societe de biologie et de ses filiales.

[77]  William Bechtel,et al.  Multiple realizability revisited , 1997 .

[78]  A. Revonsuo,et al.  The threat simulation theory of the evolutionary function of dreaming: Evidence from dreams of traumatized children , 2005, Consciousness and Cognition.

[79]  M. Jouvet,et al.  The role of monoamines and acetylcholine-containing neurons in the regulation of the sleep-waking cycle. , 1972, Ergebnisse der Physiologie, biologischen Chemie und experimentellen Pharmakologie.

[80]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[81]  J. Singer,et al.  Ode to positive constructive daydreaming , 2013, Front. Psychol..

[82]  J. Hobson,et al.  The Neuropsychology of Dreams: A Clinico-Anatomical Study , 1998, Trends in Cognitive Sciences.

[83]  Jason C. Birnholz,et al.  The development of human fetal eye movement patterns. , 1981, Science.

[84]  J. Allan Hobson,et al.  Dreaming: A Neurocognitive Approach , 1994, Consciousness and Cognition.

[85]  John J. Foxe,et al.  Determinants and mechanisms of attentional modulation of neural processing. , 2001, Frontiers in Bioscience.

[86]  J. Hobson The Dreaming Brain , 1988 .

[87]  Robert H. Wurtz,et al.  Thalamic pathways for active vision , 2011, Trends in Cognitive Sciences.

[88]  Karl J. Friston,et al.  A Hierarchy of Time-Scales and the Brain , 2008, PLoS Comput. Biol..

[89]  M. Farah The neurological basis of mental imagery: A componential analysis , 1984, Cognition.

[90]  Sean M Montgomery,et al.  Theta and Gamma Coordination of Hippocampal Networks during Waking and Rapid Eye Movement Sleep , 2008, The Journal of Neuroscience.

[91]  R. Llinás,et al.  Of dreaming and wakefulness , 1991, Neuroscience.

[92]  J. Hohwy The Predictive Mind , 2013 .

[93]  E. Perry,et al.  Neurochemistry of consciousness: cholinergic pathologies in the human brain. , 2004, Progress in brain research.

[94]  Douglas R. Hofstadter,et al.  Godel, Escher, Bach: An Eternal Golden Braid , 1981 .

[95]  S. Cykert A New Paradigm. , 2014, Chest.

[96]  Juliane Hahn,et al.  The Critique Of Pure Reason , 2016 .

[97]  J. Smallwood,et al.  Inspired by Distraction : Mind Wandering Facilitates Creative Incubation , 2012 .

[98]  D. Paré,et al.  Fast oscillations (20-40 Hz) in thalamocortical systems and their potentiation by mesopontine cholinergic nuclei in the cat. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[99]  Karl J. Friston,et al.  Waking and dreaming consciousness: Neurobiological and functional considerations , 2012, Progress in Neurobiology.

[100]  M. Nitsche,et al.  Induction of self awareness in dreams through frontal low current stimulation of gamma activity , 2014, Nature Neuroscience.

[101]  Y Kamitani,et al.  Neural Decoding of Visual Imagery During Sleep , 2013, Science.

[102]  Rajesh P. N. Rao,et al.  Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. , 1999 .

[103]  David A. Leopold,et al.  Frontiers in Systems Neuroscience Systems Neuroscience , 2022 .

[104]  J. Allan Hobson,et al.  Emotion Profiles in the Dreams of Men and Women , 1994, Consciousness and Cognition.

[105]  T. Metzinger Being No One: The Self-Model Theory of Subjectivity , 2004 .

[106]  J. J. Gilbert,et al.  Sleep in Mammals : Ecological and Constitutional Correlates , 2007 .

[107]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[108]  Ramon Greenberg,et al.  The Neuropsychology of Dreams: A Clinico-Anatomical Study , 1999 .

[109]  A. Braun,et al.  Regional cerebral blood flow throughout the sleep- wake cycle , 1997 .

[110]  C. Rittenhouse,et al.  Self-Representation and Bizarreness in Children′s Dream Reports Collected in the Home Setting , 1994, Consciousness and Cognition.

[111]  Lawrence Edelstein,et al.  Hypotheses relating to the function of the claustrum , 2012, Front. Integr. Neurosci..

[112]  J. Hobson Lucid dreaming wakes up: Response to Commentaries , 2010 .

[113]  M. Jouvet,et al.  [Electromyographic correlations of sleep in the chronic decorticate & mesencephalic cat]. , 1959, Comptes rendus des seances de la Societe de biologie et de ses filiales.

[114]  J. Hobson,et al.  REM sleep and dreaming: towards a theory of protoconsciousness , 2009, Nature Reviews Neuroscience.

[115]  R Stickgold,et al.  Brain-mind states: I. Longitudinal field study of sleep/wake factors influencing mentation report length. , 2001, Sleep.

[116]  Robert A. Wilson Two Views of Realization , 2001 .

[117]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[118]  M. Jouvet Essai sur le réve , 1973 .

[119]  R. Stickgold,et al.  Dreaming and the brain: Toward a cognitive neuroscience of conscious states , 2000, Behavioral and Brain Sciences.

[120]  G. Calvert,et al.  Multisensory integration: methodological approaches and emerging principles in the human brain , 2004, Journal of Physiology-Paris.

[121]  Pablo Torterolo,et al.  Coherent neocortical 40‐Hz oscillations are not present during REM sleep , 2013, The European journal of neuroscience.

[122]  D. Lewkowicz,et al.  The multisensory approach to development , 2012 .

[123]  Ursula Voss,et al.  Lucid dreaming: a state of consciousness with features of both waking and non-lucid dreaming. , 2009, Sleep.

[124]  C. Dreyfus-Brisac The electroencephalogram of the premature infant. , 1962, World neurology.

[125]  Andreas K. Engel,et al.  Temporal binding and the neural correlates of consciousness , 2003 .

[126]  L. Stark,et al.  Spontaneous Eye Movements During Visual Imagery Reflect the Content of the Visual Scene , 1997, Journal of Cognitive Neuroscience.

[127]  C. Jouny,et al.  EEG spectral activity during paradoxical sleep: further evidence for cognitive processing , 2000, Neuroreport.

[128]  ChrisD . Frith,et al.  Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia , 2009, Nature Reviews Neuroscience.

[129]  P. L. Parmeggiani,et al.  Thermoregulation and sleep. , 2003, Frontiers in bioscience : a journal and virtual library.

[130]  David Mumford,et al.  On the computational architecture of the neocortex , 2004, Biological Cybernetics.

[131]  R. Stickgold,et al.  Practice with Sleep Makes Perfect Sleep-Dependent Motor Skill Learning , 2002, Neuron.

[132]  J. Hobson,et al.  Dream Splicing: A New Technique for Assessing Thematic Coherence in Subjective Reports of Mental Activity , 1994, Consciousness and Cognition.

[133]  G. Dawes,et al.  Respiratory movements and rapid eye movement sleep in the foetal lamb , 1972, The Journal of physiology.

[134]  J. Duhamel,et al.  Differential effects of parietal and frontal inactivations on reaction times distributions in a visual search task , 2012, Front. Integr. Neurosci..

[135]  Emotion and Visual Imagery in Dream Reports: A Narrative Graphing Approach , 1994, Consciousness and Cognition.

[136]  C. Degueldre,et al.  Functional neuroanatomy of human rapid-eye-movement sleep and dreaming , 1996, Nature.

[137]  Fabrice Bartolomei,et al.  Electrical stimulation of a small brain area reversibly disrupts consciousness , 2014, Epilepsy & Behavior.

[138]  Karl J. Friston,et al.  The Computational Anatomy of Psychosis , 2013, Front. Psychiatry.

[139]  S. Epstein,et al.  Background gamma rhythmicity and attention in cortical local circuits: a computational study. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[140]  J. Hobson,et al.  A New Approach to Dream Bizarreness: Graphing Continuity and Discontinuity of Visual Attention in Narrative Reports , 1994, Consciousness and Cognition.

[141]  Karl J. Friston,et al.  Information and Efficiency in the Nervous System—A Synthesis , 2013, PLoS Comput. Biol..

[142]  T. Mergner,et al.  Relationship between saccadic eye movements and cortical activity as measured by fMRI: quantitative and qualitative aspects , 2001, Experimental Brain Research.

[143]  D. Wegner The mind's best trick: how we experience conscious will , 2003, Trends in Cognitive Sciences.

[144]  S. Miyauchi,et al.  Human brain activity time-locked to rapid eye movements during REM sleep , 2009, Experimental Brain Research.

[145]  Bruno Laeng,et al.  Eye scanpaths during visual imagery reenact those of perception of the same visual scene , 2002, Cogn. Sci..

[146]  R. Desimone,et al.  Laminar differences in gamma and alpha coherence in the ventral stream , 2011, Proceedings of the National Academy of Sciences.

[147]  Judith Koppehele-Gossel,et al.  Lucid dreaming: an age‐dependent brain dissociation , 2012, Journal of sleep research.

[148]  Antti Revonsuo,et al.  Consciousness, dreams and virtual realities , 1995 .

[149]  Stephen LaBerge,et al.  Lucid Dreaming: Psychophysiological Studies of Consciousness during REM Sleep , 1990 .

[150]  Karl J. Friston,et al.  Action understanding and active inference , 2011, Biological Cybernetics.

[151]  Anil K. Seth,et al.  Consciousness and Complexity , 2022 .

[152]  S. Freud Manifest dream content and latent dream thought. , 1920 .

[153]  Christian Kaufmann,et al.  Rapid eye movement-related brain activation in human sleep: a functional magnetic resonance imaging study , 2005, Neuroreport.

[154]  C. Fisher,et al.  Dream imagery: relationship to rapid eye movements of sleep. , 1962, Archives of general psychiatry.

[155]  J. Hobson,et al.  The brain as a dream state generator: an activation-synthesis hypothesis of the dream process. , 1977, The American journal of psychiatry.

[156]  V. Korenchevsky The Research Committee in the Organization of the International Biological and Medical Associations and their Congresses. , 1953, Science.

[157]  J. Hobson,et al.  Cholinergic microstimulation of the peribrachial nucleus in the cat. II. Delayed and prolonged increases in REM sleep. , 1992, Archives italiennes de biologie.

[158]  T. Nielsen,et al.  Prevalence of Auditory, Olfactory, and Gustatory Experiences in Home Dreams , 1998, Perceptual and motor skills.

[159]  D Mumford,et al.  On the computational architecture of the neocortex. II. The role of cortico-cortical loops. , 1992, Biological cybernetics.

[160]  J. Prinz A Neurofunctional Theory of Visual Consciousness , 2000, Consciousness and Cognition.

[161]  J. Pekar,et al.  fMRI evidence for multisensory recruitment associated with rapid eye movements during sleep , 2009, Human brain mapping.

[162]  A. Revonsuo Inner Presence: Consciousness as a Biological Phenomenon , 2005 .

[163]  D. Kupfer,et al.  Forebrain activation in REM sleep: an FDG PET study 1 Presented in abstract form at the Society for Neuroscience Meeting, 1996. 1 , 1997, Brain Research.

[164]  Carl Gillett,et al.  The dimensions of realization: a critique of the Standard view , 2002 .

[165]  R. McCarley,et al.  REM sleep dreams and the activation-synthesis hypothesis. , 1981, The American journal of psychiatry.

[166]  H. Roffwarg,et al.  Evidence for a directional correspondence between eye movements and dream imagery in REM sleep. , 1984, Sleep.