Reliability of the performance and safety scores of the wheelchair skills test version 4.1 for manual wheelchair users.

OBJECTIVE To evaluate the interrater, intrarater, and test-retest reliability of the total performance and safety scores of the Wheelchair Skills Test version 4.1 (WST 4.1) for manual wheelchairs operated by adult wheelchair users. DESIGN Cohort study. SETTING University research setting. PARTICIPANTS People (N=11) who used manual wheelchairs for community locomotion. INTERVENTIONS Not applicable. MAIN OUTCOME MEASURE Participants were videotaped as they completed the WST 4.1 (30 skills) on 2 separate occasions 1 to 2 weeks apart. Subsequently, raters scored the WST 4.1 from the video recordings and each participant received a total score for performance and safety. Using those scores, interrater, intrarater, and test-retest reliability were determined by using intraclass correlation coefficients (ICCs). Percentages of agreement between raters for individual skills also were calculated. RESULTS Mean ± SD overall WST 4.1 scores for performance and safety were 80.1%±8.5% and 98.0%±2.8%. ICCs for the interrater, intrarater, and test-retest reliability of the performance component were .855, .950, and .901 (P<.001). Safety component ICC scores were .061 (P=.243), .228 (P=.048), and .254 (P=.041). Percentages of agreement between raters for each test item for both the performance and safety scales ranged from 68% to 100%. CONCLUSIONS Reliability of the performance component of the WST 4.1 was excellent, whereas ICCs for the safety component indicated only slight to fair agreement, probably because of the low variability in safety scores. Additional study is needed to further evaluate the reliability of the safety component with a larger and more diverse sample group.

[1]  A. Feinstein,et al.  High agreement but low kappa: II. Resolving the paradoxes. , 1990, Journal of clinical epidemiology.

[2]  A. Feinstein,et al.  High agreement but low kappa: I. The problems of two paradoxes. , 1990, Journal of clinical epidemiology.

[3]  R Lee Kirby,et al.  Are wheelchair-skills assessment and training relevant for long-standing wheelchair users? Two case reports , 2010, Disability and rehabilitation. Assistive technology.

[4]  Krista L Best,et al.  Wheelchair skills training program for clinicians: a randomized controlled trial with occupational therapy students. , 2004, Archives of physical medicine and rehabilitation.

[5]  R. L. Kirby,et al.  The Wheelchair Skills Test: a pilot study of a new outcome measure. , 2002, Archives of physical medicine and rehabilitation.

[6]  Krista L Best,et al.  The wheelchair skills test (version 2.4): measurement properties. , 2004, Archives of physical medicine and rehabilitation.

[7]  Krista L Best,et al.  Wheelchair skills training for community-based manual wheelchair users: a randomized controlled trial. , 2005, Archives of physical medicine and rehabilitation.

[8]  Donald R. Miller,et al.  Barriers, facilitators, and access for wheelchair users: substantive and methodologic lessons from a pilot study of environmental effects. , 2002, Social science & medicine.

[9]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[10]  Joanne Yip,et al.  Development and content validation of the Wheelchair Use Confidence Scale: a mixed-methods study , 2011, Disability and rehabilitation. Assistive technology.

[11]  Development of a Walking-Safety Scale for Older Adults, Part II: Interrater and Test-Retest Agreement of the GEM Scale. , 2008, Physiotherapy Canada. Physiotherapie Canada.

[12]  L. V. D. van der Woude,et al.  Wheelchair skills tests: a systematic review , 2003, Clinical rehabilitation.

[13]  R Lee Kirby,et al.  Wheelchair skills training program: A randomized clinical trial of wheelchair users undergoing initial rehabilitation. , 2004, Archives of physical medicine and rehabilitation.