Stereoscopic depth increases intersubject correlations of brain networks

Three-dimensional movies presented via stereoscopic displays have become more popular in recent years aiming at a more engaging viewing experience. However, neurocognitive processes associated with the perception of stereoscopic depth in complex and dynamic visual stimuli remain understudied. Here, we investigate the influence of stereoscopic depth on both neurophysiology and subjective experience. Using multivariate statistical learning methods, we compare the brain activity of subjects when freely watching the same movies in 2D and in 3D. Subjective reports indicate that 3D movies are more strongly experienced than 2D movies. On the neural level, we observe significantly higher intersubject correlations of cortical networks when subjects are watching 3D movies relative to the same movies in 2D. We demonstrate that increases in intersubject correlations of brain networks can serve as neurophysiological marker for stereoscopic depth and for the strength of the viewing experience.

[1]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[2]  David S. Greenberg,et al.  Population imaging of ongoing neuronal activity in the visual cortex of awake rats , 2008, Nature Neuroscience.

[3]  Shaun Gallagher,et al.  On the possibility of naturalizing phenomenology , 2012 .

[4]  L. Cormack,et al.  Disparity- and velocity-based signals for three-dimensional motion perception in human MT+ , 2009, Nature Neuroscience.

[5]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[6]  G. DeAngelis,et al.  Cortical area MT and the perception of stereoscopic depth , 1998, Nature.

[7]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[8]  N. Logothetis,et al.  Natural vision reveals regional specialization to local motion and to contrast-invariant, global flow in the human brain. , 2008, Cerebral cortex.

[9]  M Duistermaat,et al.  Human Factors in the Age of Virtual Reality. , 2003 .

[10]  A. Cavanna,et al.  The precuneus: a review of its functional anatomy and behavioural correlates. , 2006, Brain : a journal of neurology.

[11]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[12]  K. Müller,et al.  Single-trial analysis of the neural correlates of speech quality perception , 2013, Journal of neural engineering.

[13]  Jack L. Gallant,et al.  A Continuous Semantic Space Describes the Representation of Thousands of Object and Action Categories across the Human Brain , 2012, Neuron.

[14]  N. Tzourio-Mazoyer,et al.  Automated Anatomical Labeling of Activations in SPM Using a Macroscopic Anatomical Parcellation of the MNI MRI Single-Subject Brain , 2002, NeuroImage.

[15]  A. Parker Binocular depth perception and the cerebral cortex , 2007, Nature Reviews Neuroscience.

[16]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[17]  Nicole C. Rust,et al.  In praise of artifice , 2005, Nature Neuroscience.

[18]  C. Wheatstone XVIII. Contributions to the physiology of vision. —Part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision , 1962, Philosophical Transactions of the Royal Society of London.

[19]  S. Small,et al.  From language comprehension to action understanding and back again. , 2011, Cerebral cortex.

[20]  Karel Brookhuis,et al.  Preface "Human Factors in the age of Virtual Reality" , 2003 .

[21]  P. König,et al.  A comparison of hemodynamic and neural responses in cat visual cortex using complex stimuli. , 2004, Cerebral cortex.

[22]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[23]  Eleanor A. Maguire,et al.  Studying the freely-behaving brain with fMRI , 2012, NeuroImage.

[24]  Shaun Gallagher,et al.  Intersubjectivity in perception , 2008 .

[25]  Sebastian Bosse,et al.  Toward a Direct Measure of Video Quality Perception Using EEG , 2012, IEEE Transactions on Image Processing.

[26]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.

[27]  Jody C. Culham,et al.  Bringing the real world into the fMRI scanner: Repetition effects for pictures versus real objects , 2011, Scientific reports.

[28]  Henry Samuel M Hubert Part the First , 2019, Antonio Latini’s “The Modern Steward, or The Art of Preparing Banquets Well”.

[29]  R. Crone,et al.  The history of stereoscopy , 2004, Documenta Ophthalmologica.

[30]  Chong-sun Kim Canonical Analysis of Several Sets of Variables , 1973 .

[31]  Simon B Eickhoff,et al.  Brain regions involved in human movement perception: A quantitative voxel‐based meta‐analysis , 2012, Human brain mapping.

[32]  Klaus-Robert Müller,et al.  Introduction to machine learning for brain imaging , 2011, NeuroImage.

[33]  D. Zahavi Husserl's Phenomenology , 2003 .

[34]  L. Parra,et al.  Human Neuroscience Original Research Article Correlated Components of Ongoing Eeg Point to Emotionally Laden Attention – a Possible Marker of Engagement? , 2022 .

[35]  Silvia Quattrocolo,et al.  Presence in virtual driving simulators , 2005 .

[36]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[37]  Z. Kourtzi,et al.  Multivoxel Pattern Selectivity for Perceptually Relevant Binocular Disparities in the Human Brain , 2008, The Journal of Neuroscience.

[38]  Charles Wheatstone On some remarkable and hitherto unobserved phenomena of binocular vision. , 1962 .

[39]  Russell A. Poldrack,et al.  Large-scale automated synthesis of human functional neuroimaging data , 2011, Nature Methods.

[40]  Uri Hasson,et al.  Shared and idiosyncratic cortical activation patterns in autism revealed under continuous real‐life viewing conditions , 2009, Autism research : official journal of the International Society for Autism Research.

[41]  F. Meinecke,et al.  Analysis of Multimodal Neuroimaging Data , 2011, IEEE Reviews in Biomedical Engineering.

[42]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.