NeuAR – A Review of the VR/AR Applications in the Neuroscience Domain

Since the 1980’s, computational applications based on virtual reality (VR) aimed at treating mental disorders and rehabilitating individuals with cognitive or motor disabilities have been around. They started off by focusing on simple phobias like acrophobia (Emmelkamp et al., 2002) and agoraphobia (Botella et al., 2004), fear of flying (Rothbaum, Hodges, Smith, Lee & Price, 2000), and evolved to fear of driving (Saraiva et al., 2007) or posttraumatic stress disorder (PTSD) (Gamito et al., 2010), schizophrenia (Costa & Carvalho, 2004) or traumatic brain injuries (Gamito et al., 2011a), among many others (Gamito et al., 2011b).

[1]  Rosa Maria Esteves Moreira da Costa,et al.  The acceptance of virtual reality devices for cognitive rehabilitation: a report of positive results with schizophrenia , 2004, Comput. Methods Programs Biomed..

[2]  Thomas J. Riess,et al.  Augmented Reality in Parkinson's Disease , 1999, Cyberpsychology Behav. Soc. Netw..

[3]  Giuseppe Riva,et al.  Interaction and presence in the clinical relationship: virtual reality (VR) as communicative medium between patient and therapist , 2002, IEEE Transactions on Information Technology in Biomedicine.

[4]  Giuseppe Riva,et al.  Virtual Reality in Psychotherapy: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[5]  I. Blackburn,et al.  A meta-analysis of the effects of cognitive therapy in depressed patients. , 1998, Journal of affective disorders.

[6]  W. Rymer,et al.  Comparison of Robot-Assisted Reaching to Free Reaching in Promoting Recovery From Chronic Stroke , 2001 .

[7]  B. Everitt,et al.  Cognitive remediation therapy in schizophrenia: randomised controlled trial. , 2007, The British journal of psychiatry : the journal of mental science.

[8]  Howard Rheingold,et al.  Virtual Reality , 1991 .

[9]  Christian Sandor,et al.  Lessons Learned in Designing Ubiquitous Augmented Reality User Interfaces , 2007 .

[10]  P. Thomas,et al.  A multilevel model for movement rehabilitation in Traumatic Brain Injury (TBI) using Virtual Environments , 2006, 2006 International Workshop on Virtual Rehabilitation.

[11]  Brian T. Schowengerdt,et al.  Stereoscopic retinal scanning laser display with integrated focus cues for ocular accommodation , 2004, IS&T/SPIE Electronic Imaging.

[12]  Henry Fuchs,et al.  Comparison of optical and video see-through, head-mounted displays , 1995, Other Conferences.

[13]  Giuseppe Riva,et al.  Virtual reality: a new tool for panic disorder therapy , 2002, Expert review of neurotherapeutics.

[14]  J.E. Deutsch,et al.  Wii-based compared to standard of care balance and mobility rehabilitation for two individuals post-stroke , 2009, 2009 Virtual Rehabilitation International Conference.

[15]  E. Taub,et al.  Constraint-Induced Movement Therapy: a new family of techniques with broad application to physical rehabilitation--a clinical review. , 1999, Journal of rehabilitation research and development.

[16]  J. Kollin,et al.  A Retinal Display For Virtual-Environment Applications , 1993 .

[17]  Pedro Gamito,et al.  Traumatic brain injury memory training: a virtual reality online solution , 2011 .

[18]  S. Adamovich,et al.  Virtual reality-augmented rehabilitation for patients following stroke. , 2002, Physical therapy.

[19]  Alexei A. Goon,et al.  A SURVEY OF TRACKING TECHNOLOGY FOR VIRTUAL ENVIRONMENTS , 1999 .

[20]  A. Hamm,et al.  The neuropsychology of fear learning and fear regulation. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[21]  T. Jones,et al.  Training the "less-affected" forelimb after unilateral cortical infarcts interferes with functional recovery of the impaired forelimb in rats. , 2005, Restorative neurology and neuroscience.

[22]  Adrian Iftene,et al.  Augmented Reality , 2010, 2010 12th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing.

[23]  Kurt Squire,et al.  Mad City Mystery: Developing Scientific Argumentation Skills with a Place-based Augmented Reality Game on Handheld Computers , 2007 .

[24]  Pedro Gamito,et al.  Serious Games for Serious problems: from Ludicus to Therapeuticus , 2010 .

[25]  Pedro Gamito,et al.  PTSD Elderly War Veterans: A Clinical Controlled Pilot Study , 2009, Cyberpsychology Behav. Soc. Netw..

[26]  Rosa María Baños,et al.  Using augmented reality to treat phobias , 2005, IEEE Computer Graphics and Applications.

[27]  Rosemary Luckin,et al.  “Making it real”: exploring the potential of augmented reality for teaching primary school science , 2006, Virtual Reality.

[28]  Narendra Ahuja,et al.  Using a head-mounted projective display in interactive augmented environments , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[29]  Karl M. Newell,et al.  Application of Virtual Reality Graphics in Assessment of Concussion , 2006, Cyberpsychology Behav. Soc. Netw..

[30]  Heidi Sveistrup,et al.  Motor rehabilitation using virtual reality , 2004, Journal of NeuroEngineering and Rehabilitation.

[31]  Augmented Reality Musical System for Rehabilitation of Patients with Duchenne Muscular Dystrophy , 2009 .

[32]  Mindy F Levin,et al.  Reaching in reality and virtual reality: a comparison of movement kinematics in healthy subjects and in adults with hemiparesis , 2004, Journal of NeuroEngineering and Rehabilitation.

[33]  Erik Viirre,et al.  The Virtual Retinal Display: A new Display Technology using Scanned Laser Light , 1998 .

[34]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[35]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[36]  Thomas Grechenig,et al.  Designing Tangible Table-top Interfaces for Patients in Rehabilitation , 2007, CVHI.

[37]  Theodoros N. Arvanitis,et al.  Human factors and qualitative pedagogical evaluation of a mobile augmented reality system for science education used by learners with physical disabilities , 2009, Personal and Ubiquitous Computing.

[38]  Vicki Bruce,et al.  In the Eye of the Beholder , 2000 .

[39]  Frank Biocca,et al.  Virtual Eyes Can Rearrange Your Body: Adaptation to Visual Displacement in See-Through, Head-Mounted Displays , 1998, Presence.

[40]  M. Weissman,et al.  Comprehensive Guide To Interpersonal Psychotherapy , 2000 .

[41]  Stereoscopic Displays and Virtual Reality Systems XIV , 2007 .

[42]  Woodrow Barfield,et al.  Fundamentals of Wearable Computers and Augumented Reality , 2000 .

[43]  B. Wilson.  Neuropsychological rehabilitation : theory and practice , 2003 .

[44]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[45]  Yoram Baram,et al.  Walking on Virtual Tiles , 2002, Neural Processing Letters.

[46]  M. Hartl,et al.  In the Eye of the Beholder , 1992 .

[47]  M. Levin,et al.  Practice in Stroke Survivors Improvement of Arm Movement Patterns and Endpoint Control Depends on Type of Feedback During , 2007 .

[48]  Frank Biocca,et al.  Quantification of adaptation to virtual-eye location in see-thru head-mounted displays , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[49]  P. Richard,et al.  Augmented Reality for Rehabilitation of Cognitive Disabled Children: A Preliminary Study , 2007, 2007 Virtual Rehabilitation.

[50]  R. Baños,et al.  Treating cockroach phobia with augmented reality. , 2010, Behavior therapy.

[51]  P. Weiss,et al.  The potential of virtual reality for rehabilitation. , 2004, Journal of rehabilitation research and development.

[52]  Tien-Yow Chuang,et al.  Use of Virtual Reality to Improve Upper-Extremity Control in Children With Cerebral Palsy: A Single-Subject Design , 2007, Physical Therapy.

[53]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[54]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[55]  B. Rothbaum,et al.  A controlled study of virtual reality exposure therapy for the fear of flying. , 2000, Journal of consulting and clinical psychology.

[56]  Dr.Dipl.Ing. S. Zlatanova.  Augmented Reality Technology , 2003 .

[57]  J. Edmans,et al.  Validity of a Virtual Environment for Stroke Rehabilitation , 2006, Stroke.

[58]  Suya You,et al.  Natural feature tracking for extendible robust augmented realities , 1998 .

[59]  Harald Ganster,et al.  Hybrid Tracking for Augmented Reality , 2000 .

[60]  Jannick P. Rolland,et al.  A Survey of Tracking Technologies for Virtual Environments , 2001 .

[61]  S. Kosslyn,et al.  Imagining rotation by endogenous versus exogenous forces: Distinct neural mechanisms , 2001, Neuroreport.

[62]  Xun Luo,et al.  Integration of Augmented Reality and Assistive Devices for Post-Stroke Hand Opening Rehabilitation , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[63]  M. Krijn,et al.  Virtual reality treatment versus exposure in vivo: a comparative evaluation in acrophobia. , 2002, Behaviour research and therapy.

[64]  Éric Marchand,et al.  Hybrid tracking algorithms for planar and non-planar structures subject to illumination changes , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[65]  M. Kozak,et al.  Emotional processing of fear: exposure to corrective information. , 1986, Psychological bulletin.

[66]  F. Earls,et al.  Treatment-seeking for depression by black and white Americans. , 1987, Social science & medicine.

[67]  Ulrich Neumann,et al.  Dynamic registration correction in video-based augmented reality systems , 1995, IEEE Computer Graphics and Applications.

[68]  Andrew Y. C. Nee,et al.  Augmented Reality - Some Emerging Application Areas , 2011 .

[69]  B. Everitt,et al.  Cognitive remediation therapy for schizophrenia , 2012 .

[70]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[71]  L. Ost,et al.  One-session treatment for specific phobias. , 1989, Behaviour research and therapy.

[72]  K. Mauritz,et al.  Repetitive training of isolated movements improves the outcome of motor rehabilitation of the centrally paretic hand , 1995, Journal of the Neurological Sciences.

[73]  Garrett Grindle,et al.  A perspective on intelligent devices and environments in medical rehabilitation. , 2008, Medical engineering & physics.

[74]  R. Woods,et al.  Cognitive training and cognitive rehabilitation for people with early-stage Alzheimer's disease: A review , 2004 .

[75]  G Riva,et al.  Virtual reality as a new imaginative tool in psychotherapy. , 2000, Studies in health technology and informatics.

[76]  B. Rothbaum,et al.  Exposure therapy for posttraumatic stress disorder. , 2002, American journal of psychotherapy.

[77]  Jasper A. J. Smits,et al.  DISORDERS : A META-ANALYSIS OF RANDOMIZED PLACEBO-CONTROLLED TRIALS , 2008 .

[78]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[79]  Brenda K. Wiederhold,et al.  A virtual reality exposure therapy application for Iraq war military personnel with post traumatic stress disorder: From training to toy to treatment , 2006 .

[80]  G. Davey,et al.  Phobias: A Handbook of Theory, Research and Treatment , 2000, Journal of Cognitive Psychotherapy.

[81]  Abdulmotaleb El-Saddik,et al.  AR-REHAB: An Augmented Reality Framework for Poststroke-Patient Rehabilitation , 2010, IEEE Transactions on Instrumentation and Measurement.

[82]  Albert Rizzo,et al.  Integrating haptic-tactile feedback into a video capture based VE for rehabilitation , 2006 .

[83]  B. Wilson.  Cognitive rehabilitation, an integrative neuropsychological approach , 2002 .

[84]  George D. Stetten,et al.  Real time tomographic reflection: phantoms for calibration and biopsy , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[85]  A. Rizzo,et al.  Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: a meta-analysis. , 2008, Journal of behavior therapy and experimental psychiatry.

[86]  Elizabeth A. Attree,et al.  Guest Editorial: Use of Virtual Environments in Training and Rehabilitation: International Perspectives , 2005, Cyberpsychology Behav. Soc. Netw..

[87]  T. I. King,et al.  Introduction to Cognitive Rehabilitation: Theory and Practice , 1991 .

[88]  Peter Hudson,et al.  Effective treatments for PTSD: practice guidelines from the International Society for Traumatic Stress Studies , 2011 .

[89]  M. Levin,et al.  New Approaches to Enhance Motor Function of the Upper Limb in Patients with Hemiparesis , 2005 .

[90]  Mark B. Powers,et al.  Virtual reality exposure therapy for anxiety disorders: A meta-analysis. , 2008, Journal of anxiety disorders.

[91]  Kurt Squire,et al.  Augmented Reality Simulations on Handheld Computers , 2007 .

[92]  Heidi Sveistrup,et al.  Feasibility, Motivation, and Selective Motor Control: Virtual Reality Compared to Conventional Home Exercise in Children with Cerebral Palsy , 2006, Cyberpsychology Behav. Soc. Netw..

[93]  Concepción Perpiñá,et al.  Clinically Significant Virtual Environments for the Treatment of Panic Disorder and Agoraphobia , 2004, Cyberpsychology Behav. Soc. Netw..

[94]  L G Ost.  [One-session treatment of specific phobias--a rapid and effective method]. , 1988, Lakartidningen.

[95]  Ryugo Kijima,et al.  Transition between virtual environment and workstation environment with projective head mounted display , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[96]  Oliver Bimber,et al.  Augmented Reality with Back‐Projection Systems using Transflective Surfaces , 2000, Comput. Graph. Forum.

[97]  Richard M. Satava,et al.  Interactive Technology and the New Paradigm for Healthcare , 1995 .

[98]  Ramesh Raskar,et al.  Modern approaches to augmented reality , 2005, SIGGRAPH Courses.

[99]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[100]  H Wörn,et al.  New augmented reality and robotic based methods for head‐surgery , 2005, The international journal of medical robotics + computer assisted surgery : MRCAS.

[101]  H. Stam,et al.  ''Playstation eyetoy games'' improve upper extremity-related motor functioning in subacute stroke: a randomized controlled clinical trial. , 2008, European journal of physical and rehabilitation medicine.

[102]  Touradj Ebrahimi,et al.  Hybrid Tracking for Augmented Reality , 2005 .

[103]  T. Parks.  POST-RETINAL VISUAL STORAGE. , 1965, The American journal of psychology.

[104]  Joseph Wolpe,et al.  Cognitive therapy and emotional disorders: by Aaron T. Beck International Universities Press. $15.00 , 1977 .

[105]  Albert A. Rizzo,et al.  Analysis of assets for virtual reality applications in neuropsychology , 2004 .

[106]  Rosa María Baños,et al.  Mixing Realities? An Application of Augmented Reality for the Treatment of Cockroach Phobia , 2005, Cyberpsychology Behav. Soc. Netw..

[107]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[108]  Jennifer Ann Rode,et al.  Using a large projection screen as an alternative to head-mounted displays for virtual environments , 2000, CHI.