Scientific and Technical Prospects

This chapter offers a view of future technical and scientific prospects, related to major evolutions in use. It explains the impact of technological advances on applications in the entertainment field and, more generally, on the use of VR‐AR by the general public. The chapter then discusses the potential of brain‐computer interactions (BCI). It explains the working principle of BCIs and analyzes the possibilities opened up by alternative perception mechanisms for interactions in virtual reality (VR). The chapter looks at how user perceptions can be altered in VR using pseudo‐sensory feedback. Finally, it shows that it is possible to generate illusions of movement for an immobile user by altering their movement in VR, and thus overcoming the current limitations of VR technology related to movement in the VE.

[1]  Anatole Lécuyer,et al.  Camera Motions Improve the Sensation of Walking in Virtual Environments , 2006, IEEE Virtual Reality Conference (VR 2006).

[2]  Michael Madary,et al.  Real Virtuality: A Code of Ethical Conduct. Recommendations for Good Scientific Practice and the Consumers of VR-Technology , 2016, Front. Robot. AI.

[3]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[4]  Maud Marchal,et al.  Personified and Multistate Camera Motions for First-Person Navigation in Desktop Virtual Reality , 2013, IEEE Transactions on Visualization and Computer Graphics.

[5]  Maud Marchal,et al.  Toward "Pseudo-Haptic Avatars": Modifying the Visual Animation of Self-Avatar Can Simulate the Perception of Weight Lifting , 2014, IEEE Transactions on Visualization and Computer Graphics.

[6]  Michitaka Hirose,et al.  Brain-Computer Interfaces, Virtual Reality, and Videogames , 2008, Computer.

[7]  Alexis Paljic,et al.  Evaluation of pseudo-haptic feedback for simulating torque: a comparison between isometric and elastic input devices , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[8]  Tabitha C. Peck,et al.  Putting yourself in the skin of a black avatar reduces implicit racial bias , 2013, Consciousness and Cognition.

[9]  Anatole Lécuyer,et al.  Toward Contextual SSVEP-Based BCI Controller: Smart Activation of Stimuli and Control Weighting , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[10]  P. Haggard,et al.  Neural signatures of body ownership: a sensory network for bodily self-consciousness. , 2007, Cerebral cortex.

[11]  Manos Tsakiris,et al.  Experiencing ownership over a dark-skinned body reduces implicit racial bias , 2013, Cognition.

[12]  René F. Kizilcec,et al.  The Relationship between Virtual Self Similarity and Social Anxiety , 2014, Front. Hum. Neurosci..

[13]  Charlotte Magnusson,et al.  A Pilot study on audio induced pseudo-haptics , 2008 .

[14]  Chris Barker,et al.  An Experiment on Public Speaking Anxiety in Response to Three Different Types of Virtual Audience , 2002, Presence: Teleoperators & Virtual Environments.

[15]  Simone Gori,et al.  Decreased Coherent Motion Discrimination in Autism Spectrum Disorder: The Role of Attentional Zoom-Out Deficit , 2012, PloS one.

[16]  Maud Marchal,et al.  Toward Adaptive VR Simulators Combining Visual, Haptic, and Brain-Computer Interfaces , 2013, IEEE Computer Graphics and Applications.

[17]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[18]  V. Ramachandran,et al.  Projecting sensations to external objects: evidence from skin conductance response , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[19]  Gerd Bruder,et al.  Estimation of Detection Thresholds for Redirected Walking Techniques , 2010, IEEE Transactions on Visualization and Computer Graphics.

[20]  Luca Turchet,et al.  Do You Hear a Bump or a Hole?: An Experiment on Temporal Aspects in Footsteps Recognition , 2010 .

[21]  Mel Slater,et al.  Body ownership causes illusory self-attribution of speaking and influences subsequent real speaking , 2014, Proceedings of the National Academy of Sciences.

[22]  Sharif Razzaque,et al.  The hand is slower than the eye: a quantitative exploration of visual dominance over proprioception , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[23]  Gaetano Rocco,et al.  Epithelial to Mesenchymal Transition by TGFβ-1 Induction Increases Stemness Characteristics in Primary Non Small Cell Lung Cancer Cell Line , 2011, PloS one.

[24]  Thibault Gateau,et al.  Real-Time State Estimation in a Flight Simulator Using fNIRS , 2015, PloS one.

[25]  Guillaume Gibert,et al.  OpenViBE: An Open-Source Software Platform to Design, Test, and Use BrainComputer Interfaces in Real and Virtual Environments , 2010, PRESENCE: Teleoperators and Virtual Environments.

[26]  J. Bailenson,et al.  The Proteus Effect: The Effect of Transformed Self-Representation on Behavior , 2007 .

[27]  Maureen Clerc,et al.  Brain-Computer Interfaces 1: Foundations and Methods , 2016 .

[28]  F. Lotte,et al.  EEG-based neuroergonomics for 3d user interfaces: opportunities and challenges , 2017 .

[29]  Anatole Lécuyer,et al.  An overview of research on "passive" brain-computer interfaces for implicit human-computer interaction , 2010 .

[30]  Jeremy N. Bailenson,et al.  Experiencing Nature: Embodying Animals in Immersive Virtual Environments Increases Inclusion of Nature in Self and Involvement With Nature , 2016, J. Comput. Mediat. Commun..

[31]  Konrad Paul Kording,et al.  Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception , 2015, Front. Hum. Neurosci..

[32]  M L Boninger,et al.  Ten-dimensional anthropomorphic arm control in a human brain−machine interface: difficulties, solutions, and limitations , 2015, Journal of neural engineering.

[33]  Laurent Étienne,et al.  Feeling bumps and holes without a haptic interface: the perception of pseudo-haptic textures , 2004, CHI.

[34]  Anton Nijholt,et al.  Turning Shortcomings into Challenges: Brain-Computer Interfaces for Games , 2009, INTETAIN.

[35]  Anatole Lécuyer,et al.  Haptic motion: Improving sensation of self-motion in virtual worlds with force feedback , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[36]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[37]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[38]  Ferran Argelaguet,et al.  “Wow! I Have Six Fingers!”: Would You Accept Structural Changes of Your Hand in VR? , 2016, Front. Robot. AI.

[39]  Anatole Lécuyer,et al.  "Boundary of illusion": an experiment of sensory integration with a pseudo-haptic system , 2001, Proceedings IEEE Virtual Reality 2001.

[40]  Hubert Cecotti,et al.  Spelling with non-invasive Brain–Computer Interfaces – Current and future trends , 2011, Journal of Physiology-Paris.

[41]  Eloisa Vargiu,et al.  Brain–Computer Interfaces on Track to Home: Results of the Evaluation at Disabled End-Users’ Homes and Lessons Learnt , 2015, Front. ICT.

[42]  Mel Slater,et al.  Virtual Embodiment of White People in a Black Virtual Body Leads to a Sustained Reduction in Their Implicit Racial Bias , 2016, Front. Hum. Neurosci..

[43]  J. Gibson,et al.  Adaptation, after-effect and contrast in the perception of curved lines. , 1933 .

[44]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[45]  Mel Slater,et al.  Human Tails: Ownership and Control of Extended Humanoid Avatars , 2013, IEEE Transactions on Visualization and Computer Graphics.

[46]  Valeria I. Petkova,et al.  The Perspective Matters! Multisensory Integration in Ego-Centric Reference Frames Determines Full-Body Ownership , 2011, Front. Psychology.

[47]  Glenn F. Wilson,et al.  Putting the Brain to Work: Neuroergonomics Past, Present, and Future , 2008, Hum. Factors.

[48]  F. Vignemont.  Embodiment, ownership and disownership , 2011, Consciousness and Cognition.

[49]  J.R. Wolpaw,et al.  BCI meeting 2005-workshop on signals and recording methods , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[50]  Maria V. Sanchez-Vives,et al.  Extending Body Space in Immersive Virtual Reality: A Very Long Arm Illusion , 2012, PloS one.

[51]  Mel Slater,et al.  Drumming in Immersive Virtual Reality: The Body Shapes the Way We Play , 2013, IEEE Transactions on Visualization and Computer Graphics.

[52]  M. Slater,et al.  The building blocks of the full body ownership illusion , 2013, Front. Hum. Neurosci..

[53]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[54]  Simon Richir,et al.  Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[55]  M. Slater,et al.  Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes , 2013, Proceedings of the National Academy of Sciences.

[56]  Fabien Lotte,et al.  Towards improved BCI based on human learning principles , 2015, The 3rd International Winter Conference on Brain-Computer Interface.

[57]  Maureen Clerc,et al.  Brain-Computer Interfaces 2: Technology and Applications , 2016 .

[58]  M. Slater,et al.  Multisensory Stimulation Can Induce an Illusion of Larger Belly Size in Immersive Virtual Reality , 2011, PloS one.

[59]  Cuntai Guan,et al.  Brain–Computer Interface for Neurorehabilitation of Upper Limb After Stroke , 2015, Proceedings of the IEEE.