A pilot study on virtual camera control via Steady-State VEP in immersing virtual environments

This paper presents a pilot study on virtual camera control via Steady State Visual Evoked Potentials (SSVEP) in immersing virtual environments. The electroencephalographic (EEG) oscillations, induced by two flickering virtual buttons projected on the computer-generated panorama, were recorded. The flickering frequencies were selected between 4 and 8 Hz. Applying Support Vector Machines (SVMs), for three subjects, the single trial EEG data with 2 seconds of analyzing time yielded 79.9% of average classification performance (range 71.4 to 86.6%) in inferring the gaze directions. The online studies showed a feasibility of performing virtual camera control in immersing virtual environments only by the EEG oscillations without subject training.

[1]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[2]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[3]  K.-R. Muller,et al.  The Berlin brain-computer interface: EEG-based communication without subject training , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Michitaka Hirose,et al.  EEG-based navigation of immersing virtual environment using common spatial patterns , 2008, 2008 IEEE Virtual Reality Conference.

[5]  Michitaka Hirose,et al.  Steady-State VEPs in CAVE for Walking Around the Virtual World , 2007, HCI.

[6]  J D Bayliss,et al.  A virtual reality testbed for brain-computer interface research. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[7]  Gert Pfurtscheller,et al.  Navigating Virtual Reality by Thought: What Is It Like? , 2007, PRESENCE: Teleoperators and Virtual Environments.

[8]  Michitaka Hirose,et al.  Brain Computer Interface Via Stereoscopic Images in CAVE , 2007, HCI.

[9]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[10]  John R. Smith,et al.  Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment , 2005, EURASIP J. Adv. Signal Process..

[11]  Michitaka Hirose,et al.  Development and evaluation of the CABIN immersive multiscreen display , 1999 .

[12]  G Pfurtscheller,et al.  Exploring Virtual Environments with an EEG-based BCI through Motor Imagery / Erkundung von virtuellen Welten durch Bewegungsvorstellungen mit Hilfe eines EEG-basierten BCI , 2005, Biomedizinische Technik. Biomedical engineering.

[13]  G Calhoun,et al.  Brain-computer interfaces based on the steady-state visual-evoked response. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[14]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[15]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[16]  John J. Foxe,et al.  Visual spatial attention tracking using high-density SSVEP data for independent brain-computer communication , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  L.J. Trejo,et al.  Brain-computer interfaces for 1-D and 2-D cursor control: designs using volitional control of the EEG spectrum or steady-state visual evoked potentials , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  G. Pfurtscheller,et al.  Motor imagery activates primary sensorimotor area in humans , 1997, Neuroscience Letters.

[19]  G G Celesia,et al.  Visual evoked potentials with hemifield pattern stimulation. Their use in the diagnosis of retrochiasmatic lesions. , 1981, Archives of neurology.

[20]  Gert Pfurtscheller,et al.  Walking from thought , 2006, Brain Research.

[21]  J.D. Bayliss,et al.  Use of the evoked potential P3 component for control in a virtual apartment , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[22]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.