DP3 signal as a neuro-indictor for attentional processing of stereoscopic contents in varied depths within the 'comfort zone'

Abstract When viewing stereoscopic 3D (S3D) displays, excessive binocular disparity is one of the major sources for the induced visual fatigue. Limiting the disparity within a certain range termed ‘comfort zone’ is a useful approach to alleviate the negative impact of viewing the S3D displays. Using the event-related potential (ERP) approach, we have previously showed that the differential P3 (DP3) signal evoked in an oddball task could be a useful neural indicator of the involvement of high-level cognitive functions in viewing S3D contents within the comfort zone compared to viewing 2D contents, despite of the similar subjective comfort of viewing experience for the two display conditions. It remains unclear whether the DP3 signal is sensitive enough for examination of the high-level processing when viewing S3D contents in different disparities within the comfort zone. Here, the DP3 signals were recorded while subjects performed an oddball task presented in S3D modality for three disparities (0.15, 0.45 and 0.76 arcdeg) within the comfort zone. Whereas the oddball task was of similar comfort by subjective measurement for different disparities, the DP3 signal showed monotonic delay in latency for increasing disparity, suggesting the capability of the DP3 signal for establishing a ‘cognitive comfort zone’ in terms of the high-level cognitive functions.

[1]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[2]  A. Parker.  Binocular depth perception and the cerebral cortex , 2007, Nature Reviews Neuroscience.

[3]  Wolfgang Skrandies,et al.  Assessment of depth perception using psychophysical thresholds and stereoscopically evoked brain activity , 2009, Documenta Ophthalmologica.

[4]  D. Finlay,et al.  Detection duration thresholds and evoked potential measures of stereosensitivity , 2004, Documenta Ophthalmologica.

[5]  C. C. Duncan,et al.  Event-related potentials in clinical research: Guidelines for eliciting, recording, and quantifying mismatch negativity, P300, and N400 , 2009, Clinical Neurophysiology.

[6]  H Ohzu,et al.  Accommodative responses to stereoscopic three-dimensional display. , 1997, Applied optics.

[7]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[8]  Babür Şahinoğlu.  Depth-related visually evoked potentials by dynamic random-dot stereograms in humans: negative correlation between the peaks elicited by convergent and divergent disparities , 2003, European Journal of Applied Physiology.

[9]  Chunxiao Chen,et al.  Visual fatigue caused by watching 3DTV: an fMRI study , 2015, BioMedical Engineering OnLine.

[10]  Tomoki Shiomi,et al.  Simultaneous measurement of lens accommodation and convergence in natural and artificial 3D vision , 2013 .

[11]  F. Smulders.  Simplifying jackknifing of ERPs and getting more out of it: retrieving estimates of participants' latencies. , 2010, Psychophysiology.

[12]  F. Okano,et al.  Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television , 2005, Journal of Display Technology.

[13]  Jaesung Lee,et al.  A study on the possibility of implementing a real-time stereoscopic 3D rendering TV system , 2015, Displays.

[14]  Julia Neumann,et al.  Genre-dependent effects of 3D film on presence, motion sickness, and protagonist perception , 2016, Displays.

[15]  G. McCarthy,et al.  Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. , 1977, Science.

[16]  Matthew N. Dailey,et al.  Motion parallax from head movement enhances stereoscopic displays by improving presence and decreasing visual fatigue , 2017, Displays.

[17]  B. G. Cumming,et al.  Responses of primary visual cortical neurons to binocular disparity without depth perception , 1997, Nature.

[18]  Y. Kuroiwa,et al.  Modulation of Human Visual Evoked Potentials in 3-Dimensional Perception After Stimuli Produced With an Integral Imaging Method , 2012, Clinical EEG and neuroscience.

[19]  W. Skrandies.  Depth perception and evoked brain activity: The influence of horizontal disparity and visual field location , 1997, Visual Neuroscience.

[20]  Jeff Miller,et al.  Measurement of ERP latency differences: a comparison of single-participant and jackknife-based scoring methods. , 2008, Psychophysiology.

[21]  A. Kok.  On the utility of P3 amplitude as a measure of processing capacity. , 2001, Psychophysiology.

[22]  Steven J Luck,et al.  Impaired response selection in schizophrenia: evidence from the P3 wave and the lateralized readiness potential. , 2009, Psychophysiology.

[23]  Hongmin Liu,et al.  Visual comfort enhancement in stereoscopic 3D images using saliency-adaptive nonlinear disparity mapping , 2015, Displays.

[24]  Quan Huynh-Thu,et al.  Effect of the accommodation-vergence conflict on vergence eye movements , 2014, Vision Research.

[25]  Min-Chul Park,et al.  SSVEP and ERP measurement of cognitive fatigue caused by stereoscopic 3D , 2012, Neuroscience Letters.

[26]  Margaret S. Livingstone,et al.  Stereopsis and positional acuity under dark adaptation , 1994, Vision Research.

[27]  Tomoyuki Yambe,et al.  Effect of viewing a three-dimensional movie with vertical parallax , 2019, Displays.

[28]  W Skrandies,et al.  Contrast and stereoscopic visual stimuli yield lateralized scalp potential fields associated with different neural generators. , 1991, Electroencephalography and clinical neurophysiology.

[29]  Kun Li,et al.  EEG-based detection and evaluation of fatigue caused by watching 3DTV , 2013, Displays.

[30]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[31]  Matthias Wöpking,et al.  Viewing comfort with stereoscopic pictures : an experimental study on the subjective effects of disparity magnitude and depth of focus , 1995 .

[32]  Jenny C. A. Read,et al.  True stereoscopic 3D cannot be simulated by shifting 2D content off the screen plane , 2017, Displays.

[33]  Chulhee Lee,et al.  Perceptual video quality comparison of various 3D video formats and displays , 2018, Displays.

[34]  Masahito Torii,et al.  Dynamic measurement of accommodative responses while viewing stereoscopic images , 2008 .

[35]  Masaki Emoto,et al.  Visual comfort/discomfort and visual fatigue caused by stereoscopic HDTV viewing , 2004, IS&T/SPIE Electronic Imaging.

[36]  Min-Koo Kang,et al.  A wellness platform for stereoscopic 3D video systems using EEG-based visual discomfort evaluation technology. , 2017, Applied ergonomics.

[37]  Filippo Speranza,et al.  Stereoscopic 3D-TV: Visual Comfort , 2011, IEEE Transactions on Broadcasting.

[38]  Uma Shahani,et al.  Neural and vascular responses to fused binocular stimuli: a VEP and fNIRS study. , 2012, Investigative ophthalmology & visual science.

[39]  Philip J. Corriveau,et al.  Stereoscopic Viewing and Reported Perceived Immersion and Symptoms , 2012, Optometry and vision science : official publication of the American Academy of Optometry.

[40]  W Skrandies,et al.  The Processing of Stereoscopic Information in Human Visual Cortex: Psychophysical and Electrophysiological Evidence , 2001, Clinical EEG.

[41]  James S. Wolffsohn,et al.  Target spatial frequency determines the response to conflicting defocus- and convergence-driven accommodative stimuli , 2006, Vision Research.

[42]  Jeffrey N. Rouder,et al.  Default Bayes factors for ANOVA designs , 2012 .

[43]  W. Skrandies,et al.  Stereoscopic stimuli activate different cortical neurones in man: electrophysiological evidence. , 1985, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[44]  David J. Fleet,et al.  Human cortical activity correlates with stereoscopic depth perception. , 2001, Journal of neurophysiology.

[45]  Sarah Sharples,et al.  Virtual reality induced symptoms and effects (VRISE): Comparison of head mounted display (HMD), desktop and projection display systems , 2008, Displays.

[46]  Mahmoud Maqableh,et al.  A Review on Stereoscopic 3D: Home Entertainment for the Twenty First Century , 2014 .

[47]  Robert Patterson,et al.  Review Paper: Human factors of stereo displays: An update , 2009 .

[48]  Jean-Louis de Bougrenet de la Tocnaye,et al.  3D visual comfort assessment by measuring the vertical disparity tolerance , 2017, Displays.

[49]  Yong Man Ro,et al.  fMRI analysis of excessive binocular disparity on the human brain , 2014, Int. J. Imaging Syst. Technol..

[50]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[51]  Doris Y. Tsao,et al.  Stereopsis Activates V3A and Caudal Intraparietal Areas in Macaques and Humans , 2003, Neuron.

[52]  E. Donchin.  Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[53]  S. Luck.  An Introduction to the Event-Related Potential Technique , 2005 .

[54]  Satoshi Hasegawa,et al.  Comparison of 2D and 3D Vision Gaze with Simultaneous Measurements of Accommodation and Convergence , 2014 .

[55]  B. Sahinoglu.  The effect of disparity change on binocular visual evoked potential parameters elicited by convergent dynamic random-dot stereogram stimuli in humans , 2002, European Journal of Applied Physiology.

[56]  Saeed Mahmoudpour,et al.  The effect of depth map up-sampling on the overall quality of stereopairs , 2016, Displays.

[57]  Sebastian Bosse,et al.  Objective quality assessment of stereoscopic images with vertical disparity using EEG , 2017, Journal of neural engineering.

[58]  Satoshi Hasegawa,et al.  Stereoscopic Vision Induced by Parallax Images on HMD and Its Influence on Visual Functions , 2011, HCI.

[59]  Sumio Yano,et al.  A study of visual fatigue and visual comfort for 3D HDTV/HDTV images , 2002 .

[60]  Kwanghoon Sohn,et al.  Effect of Vergence–Accommodation Conflict and Parallax Difference on Binocular Fusion for Random Dot Stereogram , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[61]  Yumi Kato,et al.  The use of video refraction to measure the dynamic properties of the near triad in observers of a 3‐D display , 2002, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[62]  Jérémy Frey,et al.  Classifying EEG Signals during Stereoscopic Visualization to Estimate Visual Comfort , 2015, Comput. Intell. Neurosci..

[63]  Masaki Emoto,et al.  Two factors in visual fatigue caused by stereoscopic HDTV images , 2004 .

[64]  Peng Ye,et al.  Comparison of DP3 Signals Evoked by Comfortable 3D Images and 2D Images — an Event-Related Potential Study using an Oddball Task , 2017, Scientific Reports.