Analysis of brain activity and response during monoscopic and stereoscopic visualization

Stereoscopic visualization in cinematography and Virtual Reality (VR) creates an illusion of depth by means of two bidimensional images corresponding to different views of a scene. This perceptual trick is used to enhance the emotional response and the sense of presence and immersivity of the observers. An interesting question is if and how it is possible to measure and analyze the level of emotional involvement and attention of the observers during a stereoscopic visualization of a movie or of a virtual environment. The research aims represent a challenge, due to the large number of sensorial, physiological and cognitive stimuli involved. In this paper we begin this research by analyzing possible differences in the brain activity of subjects during the viewing of monoscopic or stereoscopic contents. To this aim, we have performed some preliminary experiments collecting electroencephalographic (EEG) data of a group of users using a Brain- Computer Interface (BCI) during the viewing of stereoscopic and monoscopic short movies in a VR immersive installation.

[1]  Martin S. Banks,et al.  Misperceptions in stereoscopic displays: a vision science perspective , 2008, APGV '08.

[2]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Bao-Liang Lu,et al.  EEG-based emotion recognition during watching movies , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[4]  H. Petsche,et al.  Interdependencies in the spontaneous EEG while listening to music. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[5]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  A. Walker Electroencephalography, Basic Principles, Clinical Applications and Related Fields , 1982 .

[7]  Barry W. Connors,et al.  Neuroscience: Exploring the brain, 3rd ed. , 2007 .

[8]  Alan V. Oppenheim,et al.  Discrete-time Signal Processing. Vol.2 , 2001 .

[9]  M. Paradiso,et al.  Neuroscience: Exploring the Brain , 1996 .

[10]  Bernard Mendiburu,et al.  3D Movie Making: Stereoscopic Digital Cinema from Script to Screen , 2009 .

[11]  Christa Neuper,et al.  Walking by Thinking: The Brainwaves Are Crucial, Not the Muscles! , 2006, PRESENCE: Teleoperators and Virtual Environments.

[12]  A. Choromańska,et al.  Analysis of Neurophysiological Reactions to Advertising Stimuli by Means of EEG and Galvanic Skin Response Measures , 2009 .

[13]  Hisashi Toyoshima,et al.  Localization of the brain activity during stereopsis for random-dot stereo-grams by use of spatiotemporal dipole source localization method , 2008 .

[14]  中村 聡 Analysis of music-brain interaction with simultaneous measurement of regional cerebral blood flow and electroencephalogram beta rhythm in human subjects , 2000 .

[15]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[16]  D. B. Preston Spectral Analysis and Time Series , 1983 .

[17]  Quan Huynh-Thu,et al.  Examination of 3D visual attention in stereoscopic video content , 2011, Electronic Imaging.

[18]  Donald H. House,et al.  Using eye tracking to analyze stereoscopic filmmaking , 2009, SIGGRAPH '09.

[19]  Mohd Nasir Taib,et al.  IQ Index using Alpha-Beta correlation of EEG power spectrum density (PSD) , 2010, 2010 IEEE Symposium on Industrial Electronics and Applications (ISIEA).

[20]  Andreas Rößler,et al.  Monitoring Brain Activity During Use of Stereoscopic Virtual Environments , 2000, Cyberpsychology Behav. Soc. Netw..

[21]  D. Heeger,et al.  Neurocinematics: The Neuroscience of Film , 2008 .

[22]  Gert Pfurtscheller,et al.  Navigating Virtual Reality by Thought: What Is It Like? , 2007, PRESENCE: Teleoperators and Virtual Environments.

[23]  D. O. Bos,et al.  EEG-based Emotion Recognition The Influence of Visual and Auditory Stimuli , 2007 .

[24]  Jari Takatalo,et al.  What do people look at when they watch stereoscopic movies? , 2010, Electronic Imaging.

[25]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[26]  Kwang-Eun Ko,et al.  Emotion recognition using EEG signals with relative power values and Bayesian network , 2009 .

[27]  W. Ray,et al.  EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. , 1985, Science.

[28]  Yong Man Ro,et al.  Human brain response to visual fatigue caused by stereoscopic depth perception , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).