Using Virtual Reality and Music in Cognitive Disability Therapy

Traditional therapy methods for people with cognitive disabilities involve long periods of time performing exercises that can be tedious or unattractive for both patients and the professionals who work with them in specialized centers. In this work we aim at investigating the possibilities that combining music and virtual reality technology might offer for improving this scenario. Following this purpose, we applied an action research approach to co-develop with stakeholders a highly-configurable and accessible application to support exercising abilities usually targeted in rehabilitation therapy, such as coordination and motor skills, memory, and spatial perception. The results of an experiment carried out with both professionals and patients showed promising results, suggesting that this type of technology could improve the rehabilitation process, and make it more engaging.

[1]  G. Schlaug,et al.  Effects of Music Training on the Child's Brain and Cognitive Development , 2005, Annals of the New York Academy of Sciences.

[2]  Daniela E. Damian,et al.  Selecting Empirical Methods for Software Engineering Research , 2008, Guide to Advanced Empirical Software Engineering.

[3]  Phil Ellis,et al.  The Music of Sound: a new approach for children with severe and profound and multiple learning difficulties , 1997, British Journal of Music Education.

[4]  Fred D. Davis Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[5]  Thais Helena Chaves de Castro,et al.  Music Spectrum: A Music Immersion Virtual Environment for Children with Autism , 2012, DSAI.

[6]  S. Weghorst,et al.  Virtual reality and tactile augmentation in the treatment of spider phobia: a case report. , 1997, Behaviour research and therapy.

[7]  Ana Grasielle Dionísio Corrêa,et al.  GenVirtual: An Augmented Reality Musical Game for Cognitive and Motor Rehabilitation , 2007, 2007 Virtual Rehabilitation.

[8]  Roseli de Deus Lopes,et al.  Computer Assisted Music Therapy: A Case Study of an Augmented Reality Musical System for Children with Cerebral Palsy Rehabilitation , 2009, 2009 Ninth IEEE International Conference on Advanced Learning Technologies.

[9]  David J. Brown,et al.  Virtual reality and its role in removing the barriers that turn cognitive impairments into intellectual disability , 2006, Virtual Reality.

[10]  K. Ottenbacher,et al.  Task performance in virtual environments used for cognitive rehabilitation after traumatic brain injury. , 1998, Archives of physical medicine and rehabilitation.

[11]  Albert A. Rizzo,et al.  Virtual Reality in Brain Damage Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[12]  Phil Ellis Incidental Music: a case study in the development of sound therapy , 1995 .

[13]  Nikos Papadopoulos,et al.  Full immersive virtual environment CAVETM in chemistry education , 2008, Comput. Educ..

[14]  Patrice L. Weiss,et al.  Virtual Reality Provides Leisure Time Opportunities for Young Adults with Physical and Intellectual Disabilities , 2003, Cyberpsychology Behav. Soc. Netw..

[15]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[16]  Maria V. Sanchez-Vives,et al.  Influence of Music on Anxiety Induced by Fear of Heights in Virtual Reality , 2016, Front. Psychol..

[17]  P. Ellis,et al.  Living Sound: human interaction and children with autism , 2002 .

[18]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[19]  Liza Lee,et al.  The Impact of Music Activities in a Multi-Sensory Room for Children with Multiple Disabilities on Developing Positive Emotions: a Case Study , 2016 .

[20]  Virtual Reality in Neuro-Psycho-Physiology. Cognitive, clinical and methodological issues in assessment and rehabilitation. , 1997, Studies in health technology and informatics.

[21]  D. Levac,et al.  When is virtual reality "therapy"? , 2013, Archives of physical medicine and rehabilitation.

[22]  Nigel Foreman,et al.  Using virtual reality environments to aid spatial awareness in disabled children , 1996 .

[23]  Barney Dalgarno,et al.  What are the learning affordances of 3-D virtual environments? , 2010, Br. J. Educ. Technol..

[24]  Gerard Jounghyun Kim,et al.  A SWOT Analysis of the Field of Virtual Reality Rehabilitation and Therapy , 2005, Presence: Teleoperators & Virtual Environments.

[25]  A T Lee,et al.  Flight simulator platform motion and air transport pilot training. , 1989, Aviation, space, and environmental medicine.

[26]  Mau-Tsuen Yang,et al.  A Collaborative Virtual Environment for Situated Language Learning Using VEC3D , 2008, J. Educ. Technol. Soc..

[27]  John Zimmerman,et al.  Research through design as a method for interaction design research in HCI , 2007, CHI.

[28]  R. Calabró,et al.  The Growing Use of Virtual Reality in Cognitive Rehabilitation: Fact, Fake or Vision? A Scoping Review. , 2019, Journal of the National Medical Association.

[29]  R. Calabró,et al.  Cognitive rehabilitation in patients with traumatic brain injury: A narrative review on the emerging use of virtual reality , 2019, Journal of Clinical Neuroscience.

[30]  Hunter G. Hoffman,et al.  Virtual Reality Exposure Therapy for World Trade Center Post-traumatic Stress Disorder: A Case Report , 2002, Cyberpsychology Behav. Soc. Netw..

[31]  Meredith Bricken,et al.  Virtual reality learning environments: potentials and challenges , 1991, COMG.

[32]  Lieselotte van Leeuwen,et al.  Visual-music vibrations , 2008, Digit. Creativity.