Assessing the Suitability of Virtual Reality for Psychological Testing

Virtual reality (VR) is rapidly becoming an inexpensive, mainstream technology. VR technology is superambulatory as it allows participants to be examined under standardized environments and tests anywhere. In addition, it can test participants in different virtual spaces, including environments that are unsafe, inaccessible, costly or difficult to set up, or even nonexistent. We summarize the benefits and potential problems of VR technology, but we also move beyond theoretical approaches and present a customizable, open-source VR system (PSY-VR) that allows scalable psychological testing in modifiable VR environments. This system allows users to modify the environment using a simple graphical interface, without programming expertise. Moreover, as a proof-of-concept, we compare responses in a typical Flanker task between a real laboratory and a painstakingly matched virtual laboratory. Results indicate that the VR responses are comparable to real life testing, demonstrating the utility of VR for psychological assessment studies. The predicted rapid advancement of VR immersive technologies, as well the ease of their integration with physiological metrics ensures that VR-based assessment will be the modus operandi of psychological assessment in the future. This will allow controllable, low-cost assessment on a global scale.

[1]  R. Ulrich,et al.  Pain in its environmental context: Implications for designing environments to enhance pain control , 2008, PAIN.

[2]  F. J. Friedrich,et al.  Flanker compatibility effects in patients with Parkinson’s disease: Impact of target onset delay and trial-by-trial stimulus variation , 2007, Brain and Cognition.

[3]  M. Aiken,et al.  Posttraumatic stress disorder: possibilities for olfaction and virtual reality exposure therapy , 2015, Virtual Reality.

[4]  M. Csíkszentmihályi,et al.  Validity and Reliability of the Experience‐Sampling Method , 1987, The Journal of nervous and mental disease.

[5]  Trieu Phat Luu,et al.  Gait adaptation to visual kinematic perturbations using a real-time closed-loop brain–computer interface to a virtual reality avatar , 2016, Journal of neural engineering.

[6]  Mark T. Bolas,et al.  Making small spaces feel large: infinite walking in virtual reality , 2015, SIGGRAPH Emerging Technologies.

[7]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[8]  M. Rizzo,et al.  The brain in the wild: Tracking human behavior in naturalistic settings , 2017 .

[9]  D. Tulsky,et al.  Interpreting Patterns of Low Scores on the NIH Toolbox Cognition Battery , 2017, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[10]  Hannes Kaufmann,et al.  VRRobot: Robot actuated props in an infinite virtual environment , 2017, 2017 IEEE Virtual Reality (VR).

[11]  Lutz Jäncke,et al.  Neural Correlate of Spatial Presence in an Arousing and Noninteractive Virtual Reality: An EEG and Psychophysiology Study , 2006, Cyberpsychology Behav. Soc. Netw..

[12]  D. Besner,et al.  On the link between mind wandering and task performance over time , 2014, Consciousness and Cognition.

[13]  A F Sanders,et al.  The Eriksen flanker effect revisited. , 2002, Acta psychologica.

[14]  N. Fox,et al.  Cognition assessment using the NIH Toolbox , 2013, Neurology.

[15]  Hongwei Hsiao,et al.  Height Effects in Real and Virtual Environments , 2005, Hum. Factors.

[16]  M. Hirose Mixed Reality - Merging Real and Virtual Worlds , 1999 .

[17]  Ralph Schroeder Social Interaction in Virtual Environments: Key Issues, Common Themes, and a Framework for Research , 2005 .

[18]  C. Fabrigoule,et al.  Impact of time on task on ADHD patient's performances in a virtual classroom. , 2012, European journal of paediatric neurology : EJPN : official journal of the European Paediatric Neurology Society.

[19]  Yvonne de Kort,et al.  Virtual Laboratories: Comparability of Real and Virtual Environments for Environmental Psychology , 2003, Presence: Teleoperators & Virtual Environments.

[20]  H. Möller,et al.  Reliability and plasticity of response inhibition and interference control , 2013, Brain and Cognition.

[21]  Perry Forsythe,et al.  Using Serious Games and Virtual Simulations in Construction Technology Education , 2013 .

[22]  Mark B. Powers,et al.  Virtual reality exposure therapy for anxiety disorders: A meta-analysis. , 2008, Journal of anxiety disorders.

[23]  Todd Bowerly,et al.  A Virtual Reality Scenario for All Seasons: The Virtual Classroom , 2009, CNS Spectrums.

[24]  Dorret I. Boomsma,et al.  Accounting for sequential trial effects in the flanker task: Conflict adaptation or associative priming? , 2006, Memory & cognition.

[25]  Albert A. Rizzo,et al.  The Virtual Classroom: A Virtual Reality Environment for the Assessment and Rehabilitation of Attention Deficits , 2000, Cyberpsychology Behav. Soc. Netw..

[26]  C. Schmidt,et al.  Partially segregated neural networks for spatial and contextual memory in virtual navigation , 2008, Hippocampus.

[27]  M. Whitton,et al.  Physiological Measures of Presence in Virtual Environments , 2001 .

[28]  O. Desrichard,et al.  Is Medical Environment Detrimental to Memory? A Test of A White Coat Effect on Older People’s Memory Performance , 2018, Clinical gerontologist.

[29]  Susana Rodrigues,et al.  Psychophysiological Assessment of Stress Under Ecological Settings A Systematic Review , 2015 .

[30]  María I. Comeche,et al.  Psychological Assessment via the Internet: A Reliability and Validity Study of Online (vs Paper-and-Pencil) Versions of the General Health Questionnaire-28 (GHQ-28) and the Symptoms Check-List-90-Revised (SCL-90-R) , 2007, Journal of medical Internet research.

[31]  Peter Praamstra,et al.  Motor cortex activation in Parkinson's disease: Dissociation of electrocortical and peripheral measures of response generation , 1999, Movement disorders : official journal of the Movement Disorder Society.

[32]  W. Roth,et al.  Methodological considerations in ambulatory skin conductance monitoring. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[33]  D F Stegeman,et al.  Reliance on external cues for movement initiation in Parkinson's disease. Evidence from movement-related potentials. , 1998, Brain : a journal of neurology.

[34]  I. Thornton,et al.  An implicit measure of undetected change. , 2000, Spatial vision.

[35]  Burcin Becerik-Gerber,et al.  Immersive virtual environments versus physical built environments: A benchmarking study for building design and user-built environment explorations , 2015 .

[36]  M. Tarr,et al.  Virtual reality in behavioral neuroscience and beyond , 2002, Nature Neuroscience.

[37]  D. Tulsky,et al.  The clinical utility and construct validity of the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with disabilities. , 2017, Rehabilitation psychology.

[38]  Mai Otsuki,et al.  Embodied interface for levitation and navigation in a 3D large space , 2017, AH.

[39]  Tuncay Cakmak,et al.  Cyberith virtualizer: a locomotion device for virtual reality , 2014, SIGGRAPH '14.

[40]  R. Heaton,et al.  Construct Validity of the NIH Toolbox Cognition Battery in Individuals With Stroke , 2017, Rehabilitation psychology.

[41]  Michitaka Hirose,et al.  Development of surface display , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[42]  Christoph Hölscher,et al.  Virtual reality as an empirical research tool - Exploring user experience in a real building and a corresponding virtual model , 2015, Comput. Environ. Urban Syst..

[43]  B. Kapralos,et al.  Using Serious Games and Virtual Simulation for Training in the Fire Service: A Review , 2015 .

[44]  Hans-Werner Gellersen,et al.  Substitutional Reality: Using the Physical Environment to Design Virtual Reality Experiences , 2015, CHI.

[45]  Philippe Allain,et al.  ClinicaVR: Classroom-CPT: A virtual reality tool for assessing attention and inhibition in children and adolescents , 2016, Comput. Hum. Behav..

[46]  P. Emmelkamp,et al.  Can virtual reality exposure therapy gains be generalized to real-life? A meta-analysis of studies applying behavioral assessments. , 2015, Behaviour research and therapy.

[47]  Brenda K. Wiederhold,et al.  A Virtual Environment for Investigating Schizophrenic Patients' Characteristics: Assessment of Cognitive and Navigation Ability , 2003, Cyberpsychology Behav. Soc. Netw..

[48]  Poul Henning Kirkegaard,et al.  Can architectural design alter the physiological reaction to psychosocial stress? A virtual TSST experiment , 2014, Physiology & Behavior.

[49]  Jeremy C. Brooks,et al.  Virtual Reality Cue Reactivity Assessment in Cigarette Smokers , 2005, Cyberpsychology Behav. Soc. Netw..

[50]  R. Adams,et al.  Distractibility in Attention/Deficit/ Hyperactivity Disorder (ADHD): The Virtual Reality Classroom , 2009, Child neuropsychology : a journal on normal and abnormal development in childhood and adolescence.

[51]  M. Slater,et al.  Virtual reality in the assessment, understanding, and treatment of mental health disorders , 2017, Psychological Medicine.

[52]  L Pugnetti,et al.  Evaluation and retraining of adults' cognitive impairment: which role for virtual reality technology? , 1995, Computers in biology and medicine.

[53]  José Luis Pons Rovira,et al.  Virtual reality training and EMG control of the MANUS hand prosthesis , 2005, Robotica.

[54]  A Naweed,et al.  Designing simulator tools for rail research: the case study of a train driving microworld. , 2013, Applied ergonomics.

[55]  Thomas V. Wiecki,et al.  A computational analysis of flanker interference in depression , 2015, Psychological Medicine.

[56]  Behrang Keshavarz,et al.  The efficacy of airflow and seat vibration on reducing visually induced motion sickness , 2017, Experimental Brain Research.

[57]  Andreas Linn,et al.  Gaze Teleportation in Virtual Reality , 2017 .

[58]  Kay M. Stanney,et al.  Handbook of Virtual Environments - Design, Implementation, and Applications, Second Edition , 2014, Handbook of Virtual Environments, 2nd ed..

[59]  Marilyn A. Uy,et al.  The Body and the Brain: Measuring Skin Conductance Responses to Understand the Emotional Experience , 2019 .

[60]  Brita Elvevåg,et al.  Automated computerized analysis of speech in psychiatric disorders , 2014, Current opinion in psychiatry.

[61]  M. Lee,et al.  Bayesian Cognitive Modeling: A Practical Course , 2014 .

[62]  F. Sava,et al.  Virtual reality measures in neuropsychological assessment: a meta-analytic review , 2016, The Clinical neuropsychologist.

[63]  Adam W. Hoover,et al.  The effects of 0.2 Hz varying latency with 20-100 ms varying amplitude on simulator sickness in a helmet mounted display , 2015, Displays.

[64]  Beverly C. Butler,et al.  Measuring the Performance of Attention Networks with the Dalhousie Computerized Attention Battery (DalCAB): Methodology and Reliability in Healthy Adults , 2016, Front. Psychol..

[65]  Hanspeter A. Mallot,et al.  Virtual Reality and Spatial Cognition , 2015 .

[66]  Rod McCall,et al.  Infinite Reality: Avatars, Eternal Life, New Worlds, and the Dawn of the Virtual Revolution , 2011, PRESENCE: Teleoperators and Virtual Environments.

[67]  Ilse R. de Boer,et al.  The Effect of Force Feedback in a Virtual Learning Environment on the Performance and Satisfaction of Dental Students , 2017, Simulation in healthcare : journal of the Society for Simulation in Healthcare.

[68]  Toshikazu Ohshima,et al.  Virtual ISU: locomotion interface for immersive VR experience in seated position (1) , 2016, SIGGRAPH Asia Posters.

[69]  Eric J. Seibel,et al.  Using fMRI to Study the Neural Correlates of Virtual Reality Analgesia , 2006, CNS Spectrums.

[70]  Thomas A. Stoffregen,et al.  The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects , 2017, Experimental Brain Research.

[71]  Alex W. K. Wong,et al.  Cognition Among Community-Dwelling Individuals With Spinal Cord Injury , 2017, Rehabilitation psychology.

[72]  Andreas Simon,et al.  Affect and Atmosphere in Controlled Responsive Environments , 2016, HCI.

[73]  Owen Kelly,et al.  Psychosocial Stress Evoked by a Virtual Audience: Relation to Neuroendocrine Activity , 2007, Cyberpsychology Behav. Soc. Netw..

[74]  R. Heaton,et al.  Using the NIH Toolbox Cognition Battery (NIHTB-CB) in Individuals With Traumatic Brain Injury , 2017, Rehabilitation psychology.

[75]  Jari K. Hietanen,et al.  Evidence for Rapid Affective Evaluation of Environmental Scenes , 2002 .

[76]  Marcelo Knörich Zuffo,et al.  On the usability of gesture interfaces in virtual reality environments , 2005, CLIHC '05.

[77]  Joshua P. Salmon,et al.  Measuring the components of attention using the Dalhousie Computerized Attention Battery (DalCAB). , 2015, Psychological assessment.

[78]  Deborah C. Beidel,et al.  Can Virtual Reality Effectively Elicit Distress Associated with Social Anxiety Disorder? , 2015 .

[79]  Patrice L. (Tamar) Weiss,et al.  Evaluation of virtual shopping in the VMall: Comparison of post-stroke participants to healthy control groups , 2007, Disability and rehabilitation.

[80]  W. Perlstein,et al.  Temporal dissociation of components of cognitive control dysfunction in severe TBI: ERPs and the cued-Stroop task , 2006, Neuropsychologia.

[81]  Noomi Katz,et al.  Validation of the Virtual MET as an assessment tool for executive functions , 2009, Neuropsychological rehabilitation.

[82]  Oshin Vartanian,et al.  Buildings, Beauty, and the Brain: A Neuroscience of Architectural Experience , 2017, Journal of Cognitive Neuroscience.

[83]  Albert Rizzo,et al.  Is Learning and Memory Different in a Virtual Environment? , 2007, The Clinical neuropsychologist.

[84]  R. Heaton,et al.  Uncorrected Versus Demographically-Corrected Scores on the NIH Toolbox Cognition Battery in Persons With Traumatic Brain Injury and Stroke , 2017, Rehabilitation psychology.