Review of the Augmented Reality Systems for Shoulder Rehabilitation

Literature shows an increasing interest for the development of augmented reality (AR) applications in several fields, including rehabilitation. Current studies show the need for new rehabilitation tools for upper extremity, since traditional interventions are less effective than in other body regions. This review aims at: Studying to what extent AR applications are used in shoulder rehabilitation, examining wearable/non-wearable technologies employed, and investigating the evidence supporting AR effectiveness. Nine AR systems were identified and analyzed in terms of: Tracking methods, visualization technologies, integrated feedback, rehabilitation setting, and clinical evaluation. Our findings show that all these systems utilize vision-based registration, mainly with wearable marker-based tracking, and spatial displays. No system uses head-mounted displays, and only one system (11%) integrates a wearable interface (for tactile feedback). Three systems (33%) provide only visual feedback; 66% present visual-audio feedback, and only 33% of these provide visual-audio feedback, 22% visual-audio with biofeedback, and 11% visual-audio with haptic feedback. Moreover, several systems (44%) are designed primarily for home settings. Three systems (33%) have been successfully evaluated in clinical trials with more than 10 patients, showing advantages over traditional rehabilitation methods. Further clinical studies are needed to generalize the obtained findings, supporting the effectiveness of the AR applications.

[1]  V. Ferrari,et al.  Augmented reality in open surgery , 2018, Updates in Surgery.

[2]  G. Merolla,et al.  Robotics in shoulder rehabilitation. , 2014, Muscles, ligaments and tendons journal.

[3]  Leigh Hale,et al.  An affordable, computerised, table-based exercise system for stroke survivors , 2010, Disability and rehabilitation. Assistive technology.

[4]  Meng Ma,et al.  MirrARbilitation: A clinically-related gesture recognition interactive tool for an AR rehabilitation system , 2016, Comput. Methods Programs Biomed..

[5]  Daniel Medeiros,et al.  SleeveAR: Augmented Reality for Rehabilitation using Realtime Feedback , 2016, IUI.

[6]  Egui Zhu,et al.  Augmented reality in healthcare education: an integrative review , 2014, PeerJ.

[7]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[8]  Sara Condino,et al.  How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens , 2018, Journal of healthcare engineering.

[9]  T. Mulder Motor imagery and action observation: cognitive tools for rehabilitation , 2007, Journal of Neural Transmission.

[10]  George Drettakis,et al.  Accommodation and Comfort in Head-Mounted Displays , 2018 .

[11]  Alessandro De Mauro,et al.  Virtual Reality Based Rehabilitation and Game Technology , 2011, EICS4Med.

[12]  Allen G. Taylor,et al.  What Is the Microsoft HoloLens , 2016 .

[13]  Sehat Ullah,et al.  A Survey on Augmented Reality Challenges and Tracking , 2016 .

[14]  S. Adamovich,et al.  Virtual reality-augmented rehabilitation for patients following stroke. , 2002, Physical therapy.

[15]  -. YeeMonAung A Novel Upper Limb Rehabilitation System with Self-Driven Virtual Arm Illusion , 2015 .

[16]  Roseli de Deus Lopes,et al.  An augmented reality system for upper-limb post-stroke motor rehabilitation: a feasibility study , 2016, Disability and rehabilitation. Assistive technology.

[17]  Khoi Nguyen,et al.  Computer-vision-based registration techniques for augmented reality , 1996, Other Conferences.

[18]  R. Riener,et al.  Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review , 2012, Psychonomic Bulletin & Review.

[19]  Justin Dunn,et al.  Virtual and augmented reality in the treatment of phantom limb pain: A literature review. , 2017, NeuroRehabilitation.

[20]  Adel Al-Jumaily,et al.  Augmented reality game based multi-usage rehabilitation therapist for stroke patients , 2014 .

[21]  A. Fugl-Meyer,et al.  The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. , 1975, Scandinavian journal of rehabilitation medicine.

[22]  Sara Condino,et al.  Is the cervical fascia an anatomical proteus? , 2015, Surgical and Radiologic Anatomy.

[23]  Svend Erik Mathiassen,et al.  Musculoskeletal health and work ability in physically demanding occupations: study protocol for a prospective field study on construction and health care workers , 2014, BMC Public Health.

[24]  A. Meola,et al.  Augmented reality in neurosurgery: a systematic review , 2017, Neurosurgical Review.

[25]  E. Noé,et al.  Effect of a mixed reality-based intervention on arm, hand, and finger function on chronic stroke , 2016, Journal of NeuroEngineering and Rehabilitation.

[26]  R. Baños,et al.  Transforming Experience: The Potential of Augmented Reality and Virtual Reality for Enhancing Personal and Clinical Change , 2016, Front. Psychiatry.

[27]  Tien-Yow Chuang,et al.  Effects of Virtual-Reality-Augmented Cardiopulmonary Rehabilitation Programs for Patients with Cardiovascular Diseases: A Systemic Review , 2018 .

[28]  Gilson A. Giraldi,et al.  A Semi-automatic Markerless Augmented Reality Approach for On-Patient Volumetric Medical Data Visualization , 2014, 2014 XVI Symposium on Virtual and Augmented Reality.

[29]  Yee Mon Aung,et al.  Augmented reality-based RehaBio system for shoulder rehabilitation , 2014, Int. J. Mechatronics Autom..

[30]  Veronica Teichrieb,et al.  Poster: Improving motor rehabilitation process through a natural interaction based system using Kinect sensor , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[31]  Hossein Mousavi Hondori,et al.  Choice of Human–Computer Interaction Mode in Stroke Rehabilitation , 2016, Neurorehabilitation and neural repair.

[32]  Tack-Don Han,et al.  Enhancing Marker-Based AR Technology , 2011, HCI.

[33]  Joaquim A. Jorge,et al.  Augmented Reality for Rehabilitation Using Multimodal Feedback , 2015, REHAB.

[34]  Eleonora Vannini,et al.  Non-orthopaedic causes of shoulder pain: what the shoulder expert must remember , 2012, MUSCULOSKELETAL SURGERY.

[35]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[36]  H Martin Schepers,et al.  Validation of wearable visual feedback for retraining foot progression angle using inertial sensors and an augmented reality headset , 2018, Journal of NeuroEngineering and Rehabilitation.

[37]  Yee Mon Aung,et al.  Augmented Reality based Illusion System with biofeedback , 2014, 2nd Middle East Conference on Biomedical Engineering.

[38]  Holger Regenbrecht,et al.  Augmented reality applications in rehabilitation to improve physical outcomes , 2012 .

[39]  Veronica Teichrieb,et al.  Guidance and Movement Correction Based on Therapeutics Movements for Motor Rehabilitation Support Systems , 2012, 2012 14th Symposium on Virtual and Augmented Reality.

[40]  A. Carr,et al.  Shoulder pain: diagnosis and management in primary care , 2005, BMJ : British Medical Journal.

[41]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[42]  G. Burdea Virtual Rehabilitation - Benefits and Challenges , 2003, Yearbook of Medical Informatics.

[43]  Bernard C. Kress,et al.  11‐1: Invited Paper: Towards the Ultimate Mixed Reality Experience: HoloLens Display Architecture Choices , 2017 .

[44]  Stefano Cagnoni,et al.  Design of a Wearable Sensing System for Human Motion Monitoring in Physical Rehabilitation , 2013, Sensors.

[45]  S Condino,et al.  Natale et. al.'s response to Stecco's fascial nomenclature editorial. , 2014, Journal of bodywork and movement therapies.

[46]  K. Walker-Bone,et al.  Shoulder disorders and occupation. , 2015, Best practice & research. Clinical rheumatology.

[47]  Gautam Roy,et al.  Disability and Rehabilitation Services in India: Issues and Challenges , 2012, Journal of family medicine and primary care.

[48]  A. Cuschieri,et al.  A Systematic Review of Virtual Reality Simulators for Robot-assisted Surgery. , 2016, European urology.

[49]  Hong Hua Enabling Focus Cues in Head-Mounted Displays , 2017 .

[50]  Fabrizio Cutolo,et al.  Proof of Concept: Wearable Augmented Reality Video See-Through Display for Neuro-Endoscopy , 2018, AVR.