Interrater Reliability of the Power Mobility Road Test in the Virtual Reality-Based Simulator-2.

OBJECTIVE To assess interrater reliability of the Power Mobility Road Test (PMRT) when administered through the Virtual Reality-based SIMulator-version 2 (VRSIM-2). DESIGN Within-subjects repeated-measures design. SETTING Participants interacted with VRSIM-2 through 2 display options (desktop monitor vs immersive virtual reality screens) using 2 control interfaces (roller system vs conventional movement-sensing joystick), providing 4 different driving scenarios (driving conditions 1-4). Participants performed 3 virtual driving sessions for each of the 2 display screens and 1 session through a real-world driving course (driving condition 5). The virtual PMRT was conducted in a simulated indoor office space, and an equivalent course was charted in an open space for the real-world assessment. After every change in driving condition, participants completed a self-reported workload assessment questionnaire, the Task Load Index, developed by the National Aeronautics and Space Administration. PARTICIPANTS A convenience sample of electric-powered wheelchair (EPW) athletes (N=21) recruited at the 31st National Veterans Wheelchair Games. INTERVENTIONS Not applicable. MAIN OUTCOME MEASURES Total composite PMRT score. RESULTS The PMRT had high interrater reliability (intraclass correlation coefficient [ICC]>.75) between the 2 raters in all 5 driving conditions. Post hoc analyses revealed that the reliability analyses had >80% power to detect high ICCs in driving conditions 1 and 4. CONCLUSIONS The PMRT has high interrater reliability in conditions 1 and 4 and could be used to assess EPW driving performance virtually in VRSIM-2. However, further psychometric assessment is necessary to assess the feasibility of administering the PMRT using the different interfaces of VRSIM-2.

[1]  Yuh Jang,et al.  Wheelchair-related accidents: relationship with wheelchair-using behavior in active community wheelchair users. , 2011, Archives of physical medicine and rehabilitation.

[2]  Susana Rubio,et al.  Evaluation of Subjective Mental Workload: A Comparison of SWAT, NASA‐TLX, and Workload Profile Methods , 2004 .

[3]  Allan Donner,et al.  Sample size requirements for the design of reliability study: review and new results , 2004 .

[4]  Rory A Cooper,et al.  Development of a wheelchair virtual driving environment: trials with subjects with traumatic brain injury. , 2008, Archives of physical medicine and rehabilitation.

[5]  Shirley G Fitzgerald,et al.  Comparison of virtual and real electric powered wheelchair driving using a position sensing joystick and an isometric joystick. , 2002, Medical engineering & physics.

[6]  Rory A Cooper,et al.  Comparison of virtual wheelchair driving performance of people with traumatic brain injury using an isometric and a conventional joystick. , 2011, Archives of physical medicine and rehabilitation.

[7]  Theo Gasser,et al.  Assessing intrarater, interrater and test–retest reliability of continuous measurements , 2002, Statistics in medicine.

[8]  James S. Krause,et al.  Risk of Fall-Related Injuries among Ambulatory Participants with Spinal Cord Injury. , 2013, Topics in spinal cord injury rehabilitation.

[9]  L Fehr,et al.  Adequacy of power wheelchair control interfaces for persons with severe disabilities: a clinical survey. , 2000, Journal of rehabilitation research and development.

[10]  P. Weiss,et al.  Use of a computer simulator for training children with disabilities in the operation of a powered wheelchair. , 1998, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[11]  David J Pittenger,et al.  A protocol for assessment of risk in wheelchair driving within a healthcare facility , 2003, Disability and rehabilitation.

[12]  Alicia M Koontz,et al.  Manual wheelchair propulsion patterns on natural surfaces during start-up propulsion. , 2009, Archives of physical medicine and rehabilitation.

[13]  Alex Mihailidis,et al.  Effectiveness of a Wheelchair Skills Training Program for Powered Wheelchair Users: A Randomized Controlled Trial. , 2015, Archives of physical medicine and rehabilitation.

[14]  Rory A Cooper,et al.  Preliminary evaluation of variable compliance joystick for people with multiple sclerosis. , 2014, Journal of rehabilitation research and development.

[15]  Shirley G Fitzgerald,et al.  Tips and falls during electric-powered wheelchair driving: effects of seatbelt use, legrests, and driving speed. , 2003, Archives of physical medicine and rehabilitation.

[16]  Michael L Boninger,et al.  Increases in Wheelchair Breakdowns, Repairs, and Adverse Consequences for People with Traumatic Spinal Cord Injury , 2012, American journal of physical medicine & rehabilitation.

[17]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[18]  Glenis Donaldson,et al.  The Social Implications of Increases in Wheelchair Use. , 2004 .

[19]  I Stott,et al.  The use of virtual reality to train powered wheelchair users and test new wheelchair systems , 2000, International journal of rehabilitation research. Internationale Zeitschrift fur Rehabilitationsforschung. Revue internationale de recherches de readaptation.

[20]  William C Miller,et al.  Measuring wheelchair intervention outcomes: Development of the Wheelchair Outcome Measure , 2007, Disability and rehabilitation. Assistive technology.

[21]  Noor Azina Ismail,et al.  Statistical Methods Used to Test for Agreement of Medical Instruments Measuring Continuous Variables in Method Comparison Studies: A Systematic Review , 2012, PloS one.

[22]  Samantha Massengale,et al.  Effect of Visual Perception, Visual Function, Cognition, and Personality on Power Wheelchair Use in Adults , 2005, Assistive technology : the official journal of RESNA.

[23]  Deirdre R. Dawson,et al.  Development of the Power-Mobility Indoor Driving Assessment for Residents of Long-Term Care Facilities: A Preliminary Report , 1994 .

[24]  C. Terwee,et al.  When to use agreement versus reliability measures. , 2006, Journal of clinical epidemiology.

[25]  Patricia A Higgins,et al.  Understanding the error of our ways: mapping the concepts of validity and reliability. , 2006, Nursing outlook.

[26]  Kara Edwards,et al.  A survey of adult power wheelchair and scooter users , 2010, Disability and rehabilitation. Assistive technology.

[27]  Rory A Cooper,et al.  Virtual Electric Power Wheelchair Driving Performance of Individuals with Spastic Cerebral Palsy , 2012, American journal of physical medicine & rehabilitation.

[28]  L. Portney,et al.  Foundations of Clinical Research: Applications to Practice , 2015 .

[29]  R. L. Kirby,et al.  Wheelchair-related falls in veterans with spinal cord injury residing in the community: a prospective cohort study. , 2010, Archives of physical medicine and rehabilitation.

[30]  E. A. Attree,et al.  The role of virtual reality technology in the assessment and training of inexperienced powered wheelchair users , 2002, Disability and rehabilitation.

[31]  Claude Vincent,et al.  Development of an obstacle course assessment of wheelchair user performance (OCAWUP): A content validity study , 2004 .

[32]  R Lee Kirby,et al.  Fatal Wheelchair-related Accidents in the United States , 1990, American journal of physical medicine & rehabilitation.

[33]  Michiel J. A. Jannink,et al.  An Electric Scooter Simulation Program for Training the Driving Skills of Stroke Patients with Mobility Problems: A Pilot Study , 2008, Cyberpsychology Behav. Soc. Netw..

[34]  Dagmar Sternad,et al.  Sensitivity of Smoothness Measures to Movement Duration, Amplitude, and Arrests , 2009, Journal of motor behavior.

[35]  François Routhier,et al.  Driving performance in a power wheelchair simulator , 2012, Disability and rehabilitation. Assistive technology.

[36]  H Stephen Kaye,et al.  Demographics and Trends in Wheeled Mobility Equipment Use and Accessibility in the Community , 2010, Assistive technology : the official journal of RESNA.

[37]  Krista L Best,et al.  The wheelchair skills test (version 2.4): measurement properties. , 2004, Archives of physical medicine and rehabilitation.

[38]  David L Streiner,et al.  The difference between reliability and agreement. , 2011, Journal of clinical epidemiology.

[39]  Å. Brandt,et al.  Mobility devices to promote activity and participation: a systematic review. , 2009, Journal of rehabilitation medicine.

[40]  Claudine Auger,et al.  Issues for the selection of wheelchair-specific activity and participation outcome measures: a review. , 2008, Archives of physical medicine and rehabilitation.

[41]  A. Hrõbjartsson,et al.  Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. , 2011, Journal of clinical epidemiology.

[42]  P J Holliday,et al.  Understanding and measuring powered wheelchair mobility and manoeuvrability. Part I. Reach in confined spaces , 2005, Disability and rehabilitation.

[43]  Rory A Cooper,et al.  Assessment of wheelchair driving performance in a virtual reality-based simulator , 2013, The journal of spinal cord medicine.

[44]  Ethel Kaiserman-Goldenstein,et al.  Reliability and Validity of the Power-Mobility Community Driving Assessment , 2007, Assistive technology : the official journal of RESNA.

[45]  Rory A. Cooper,et al.  A Participatory Approach to Develop the Power Mobility Screening Tool and the Power Mobility Clinical Driving Assessment Tool , 2014, BioMed research international.