USEQ: A Short Questionnaire for Satisfaction Evaluation of Virtual Rehabilitation Systems

New emerging technologies have proven their efficacy in aiding people in their rehabilitation. The tests that are usually used to evaluate usability (in general) or user satisfaction (in particular) of this technology are not specifically focused on virtual rehabilitation and patients. The objective of this contribution is to present and evaluate the USEQ (User Satisfaction Evaluation Questionnaire). The USEQ is a questionnaire that is designed to properly evaluate the satisfaction of the user (which constitutes part of usability) in virtual rehabilitation systems. Forty patients with balance disorders completed the USEQ after their first session with ABAR (Active Balance Rehabilitation), which is a virtual rehabilitation system that is designed for the rehabilitation of balance disorders. Internal consistency analysis and exploratory factor analysis were carried out to identify the factor structure of the USEQ. The six items of USEQ were significantly associated with each other, and the Cronbach alpha coefficient for the questionnaire was 0.716. In an analysis of the principal components, a one-factor solution was considered to be appropriate. The findings of the study suggest that the USEQ is a reliable questionnaire with adequate internal consistency. With regard to patient perception, the patients found the USEQ to be an easy-to-understand questionnaire with a convenient number of questions.

[1]  Heidi Sveistrup,et al.  Motor rehabilitation using virtual reality , 2004, Journal of NeuroEngineering and Rehabilitation.

[2]  Christian Sandor,et al.  A usability scale for handheld augmented reality , 2014, VRST '14.

[3]  Thierry Dutoit,et al.  A subjective assessment of a P300 BCI system for lower-limb rehabilitation purposes , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  D. Streiner.  Starting at the Beginning: An Introduction to Coefficient Alpha and Internal Consistency , 2003, Journal of personality assessment.

[5]  Timo Jokela,et al.  The standard of user-centered design and the standard definition of usability: analyzing ISO 13407 against ISO 9241-11 , 2003, CLIHC '03.

[6]  Ergonomic requirements for office work with visual display terminals ( VDTs ) — Part 11 : Guidance on usability , 1998 .

[7]  Holger Regenbrecht,et al.  Visual manipulations for motor rehabilitation , 2012, Comput. Graph..

[8]  Sergio Albiol-Pérez,et al.  Suitability of virtual rehabilitation for elderly: A study of a virtual rehabilitation system using the SEQ , 2013 .

[9]  Nigel Bevan,et al.  International standards for HCI and usability , 2001, Int. J. Hum. Comput. Stud..

[10]  Kathryn Fackrell,et al.  Hyperacusis Questionnaire as a Tool for Measuring Hypersensitivity to Sound in a Tinnitus Research Population , 2015, BioMed research international.

[11]  Dara Meldrum,et al.  Effectiveness of conventional versus virtual reality based vestibular rehabilitation in the treatment of dizziness, gait and balance impairment in adults with unilateral peripheral vestibular loss: a randomised controlled trial , 2012, BMC Ear, Nose and Throat Disorders.

[12]  Grassyara Pinho Tolentino,et al.  Usability of Serious Games for Health , 2011, 2011 Third International Conference on Games and Virtual Worlds for Serious Applications.

[13]  Patrice L Tamar Weiss,et al.  Video-capture virtual reality system for patients with paraplegic spinal cord injury. , 2005, Journal of rehabilitation research and development.

[14]  Dara Meldrum,et al.  Virtual reality rehabilitation of balance: assessment of the usability of the Nintendo Wii® Fit Plus , 2012, Disability and rehabilitation. Assistive technology.

[15]  Mark Bolas,et al.  Designing informed game-based rehabilitation tasks leveraging advances in virtual reality , 2012, Disability and rehabilitation.

[16]  Sonia A Duffy,et al.  The Development of the Tobacco Tactics Website , 2013, JMIR research protocols.

[17]  Joon-Ho Shin,et al.  A task-specific interactive game-based virtual reality rehabilitation system for patients with stroke: a usability test and two clinical experiments , 2014, Journal of NeuroEngineering and Rehabilitation.

[18]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[19]  L. Cronbach.  Coefficient alpha and the internal structure of tests , 1951 .

[20]  Noor Azah Abd Aziz,et al.  Effects of substituting a portion of standard physiotherapy time with virtual reality games among community-dwelling stroke survivors , 2013, BMC Neurology.

[21]  R S Kalawsky,et al.  VRUSE--a computerised diagnostic tool: for usability evaluation of virtual/synthetic environment systems. , 1999, Applied ergonomics.

[22]  Thomas Grechenig,et al.  Comparing the immediate usability of graffiti 2 and virtual keyboard , 2004, CHI EA '04.

[23]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[24]  C. Colomer,et al.  Effectiveness of a Wii balance board-based system (eBaViR) for balance rehabilitation: a pilot randomized clinical trial in patients with acquired brain injury , 2011, Journal of NeuroEngineering and Rehabilitation.

[25]  J. B. Brooke,et al.  SUS: a retrospective , 2013 .

[26]  G. Lewis,et al.  Virtual reality games for movement rehabilitation in neurological conditions: how do we meet the needs and expectations of the users? , 2012, Disability and rehabilitation.

[27]  Luc P de Witte,et al.  User-centered development and testing of a monitoring system that provides feedback regarding physical functioning to elderly people , 2013, Patient preference and adherence.

[28]  José-Antonio Lozano-Quilis,et al.  SEQ: Suitability Evaluation Questionnaire for Virtual Rehabilitation systems. Application in a Virtual Rehabilitation system for Balance Rehabilitation , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[29]  Yu-Hsiu Hung,et al.  The Survey of Usability Evaluation in Social Network Sites' Reply Mechanism , 2013, HCI.

[30]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[31]  Jasna Kuljis,et al.  Aligning usability and security: a usability study of Polaris , 2006, SOUPS '06.

[32]  Sergio Albiol-Pérez,et al.  Balance virtual rehabilitation in the elderly: The use of the “ABAR” system , 2013 .

[33]  Oscar Mauricio Serrano Jaimes,et al.  EVALUACION DE LA USABILIDAD EN SITIOS WEB, BASADA EN EL ESTANDAR ISO 9241-11 (International Standard (1998) Ergonomic requirements For office work with visual display terminals (VDTs)-Parts II: Guidance on usability , 2012 .

[34]  K Ann McKibbon,et al.  Engaging With a Wiki Related to Knowledge Translation: A Survey of WhatisKT Wiki Users , 2014, Journal of medical Internet research.

[35]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[36]  Paul Chapman,et al.  Feasibility of the Nintendo WiiFit™ for improving walking in individuals with a lower limb amputation , 2013, SAGE open medicine.

[37]  A retrospective. , 2007, Ostomy/wound management.

[38]  Nikhil Deshpande,et al.  A novel computerized surgeon–machine interface for robot‐assisted laser phonomicrosurgery , 2014, The Laryngoscope.

[39]  Mariano Alcañiz Raya,et al.  The Role of Virtual Motor Rehabilitation: A Quantitative Analysis Between Acute and Chronic Patients With Acquired Brain Injury , 2014, IEEE Journal of Biomedical and Health Informatics.

[40]  T. Ward,et al.  Usability evaluation of e-motion: A virtual rehabilitation system designed to demonstrate, instruct and monitor a therapeutic exercise programme , 2008, 2008 Virtual Rehabilitation.

[41]  Dido Green,et al.  Use of virtual reality in rehabilitation of movement in children with hemiplegia − A multiple case study evaluation , 2012, Disability and rehabilitation.

[42]  Talin Babikian,et al.  Neurocognitive outcomes and recovery after pediatric TBI: meta-analytic review of the literature. , 2009, Neuropsychology.

[43]  Alain Abran,et al.  Usability Meanings and Interpretations in ISO Standards , 2003, Software Quality Journal.

[44]  Timo Jokela,et al.  Methods for quantitative usability requirements: a case study on the development of the user interface of a mobile phone , 2006, Personal and Ubiquitous Computing.

[45]  Patrice L. Weiss,et al.  Adapting an immersive virtual reality system for rehabilitation , 2003, Comput. Animat. Virtual Worlds.

[46]  P. Verschure,et al.  Neurorehabilitation using the virtual reality based Rehabilitation Gaming System: methodology, design, psychometrics, usability and validation , 2010, Journal of NeuroEngineering and Rehabilitation.