Test-retest reliability and rater agreements of assessment of capacity for myoelectric control version 2.0.

The Assessment of Capacity for Myoelectric Control (ACMC) is an observation-based tool that evaluates ability to control a myoelectric prosthetic hand. Validity evidence led to ACMC version 2.0, but the test-retest reliability and minimal detectable change (MDC) of the ACMC have never been evaluated. Investigation of rater agreements in this version was also needed because it has new definitions in certain rating categories and items. Upper-limb prosthesis users (n = 25, 15 congenital, 10 acquired; mean age 27.5 yr) performed one standardized activity twice, 2 to 5 wk apart. Activity performances were videorecorded and assessed by two ACMC raters. Data were analyzed by weighted kappa, intraclass correlation coefficient (ICC), and Bland-Altman method. For test-retest reliability, weighted kappa agreements were fair to excellent (0.52 to 1.00), ICC2,1 was 0.94, and one user was located outside the limits of agreement in the Bland-Altman plot. MDC95 was less than or equal to 0.55 logits (1 rater) and 0.69 logits (2 raters). For interrater reliability, weighted kappa agreements were fair to excellent in both sessions (0.44 to 1.00), and ICC2,1 was 0.95 (test) and 0.92 (retest). Intrarater agreement (rater 1) was also excellent (ICC3,1 0.98). Evidence regarding the reliability of the ACMC is satisfactory and MDC95 can be used to indicate change.

[1]  C. Light,et al.  Establishing a standardized clinical assessment tool of pathologic and prosthetic hand function: normative data, reliability, and validity. , 2002, Archives of physical medicine and rehabilitation.

[2]  Helen Y N Lindner,et al.  Upper Limb Prosthetic Outcome Measures: Review and Content Comparison Based on International Classification of Functioning, Disability and Health , 2010, Prosthetics and orthotics international.

[3]  Ching-Fan Sheu,et al.  The minimal detectable change of the simplified stroke rehabilitation assessment of movement measure. , 2008, Journal of rehabilitation medicine.

[4]  A. Hrõbjartsson,et al.  Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed. , 2011, Journal of clinical epidemiology.

[5]  Alexander W Dromerick,et al.  Estimating minimal clinically important differences of upper-extremity measures early after stroke. , 2008, Archives of physical medicine and rehabilitation.

[6]  J. Fleiss,et al.  The measurement of interrater agreement , 2004 .

[7]  A. Eliasson,et al.  Influence of standardized activities on validity of Assessment of Capacity for Myoelectric Control. , 2013, Journal of rehabilitation research and development.

[8]  Dick H. Plettenburg,et al.  Bernstein’s Levels of Construction of Movements Applied to Upper Limb Prosthetics , 2012 .

[9]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[10]  C. Velozo,et al.  Minimum Detectable Change of the Berg Balance Scale and Dynamic Gait Index in Older Persons at Risk for Falling , 2011, Journal of geriatric physical therapy.

[11]  Helen Y N Lindner,et al.  Assessment of capacity for myoelectric control: evaluation of construct and rating scale. , 2009, Journal of rehabilitation medicine.

[12]  C. Fox,et al.  Applying the Rasch Model: Fundamental Measurement in the Human Sciences , 2001 .

[13]  J. Steiner,et al.  Health and Quality of Life Outcomes , 2006 .

[14]  F. Molitor,et al.  The Unilateral Below Elbow Test: a function test for children with unilateral congenital below elbow deficiency. , 2006, Developmental medicine and child neurology.

[15]  L. Resnik,et al.  Development and evaluation of the activities measure for upper limb amputees. , 2013, Archives of Physical Medicine and Rehabilitation.

[16]  B. Wright,et al.  Best test design , 1979 .

[17]  M. King.  A point of minimal important difference (MID): a critique of terminology and methods , 2011, Expert review of pharmacoeconomics & outcomes research.

[18]  Alberto Esquenazi,et al.  Unilateral upper-limb loss: satisfaction and prosthetic-device use in veterans and servicemembers from Vietnam and OIF/OEF conflicts. , 2010, Journal of rehabilitation research and development.

[19]  K. McGraw,et al.  Forming inferences about some intraclass correlation coefficients. , 1996 .

[20]  A. Eliasson,et al.  Assessment of capacity for myoelectric control: a new Rasch-built measure of prosthetic hand control. , 2005, Journal of rehabilitation medicine.

[21]  H. Stam,et al.  Evaluation of arm and prosthetic functioning in children with a congenital transverse reduction deficiency of the upper limb. , 2007, Journal of rehabilitation medicine.

[22]  Sandra A. McIntire,et al.  Foundations of Psychological Testing: A Practical Approach , 2006 .

[23]  Michael A. Alexander,et al.  Pediatric Rehabilitation: Principles And Practice , 2009 .

[24]  C. Bombardier,et al.  Looking for important change/differences in studies of responsiveness. OMERACT MCID Working Group. Outcome Measures in Rheumatology. Minimal Clinically Important Difference. , 2001, The Journal of rheumatology.

[25]  Thomas Eckes,et al.  Introduction to Many-Facet Rasch Measurement , 2011 .

[26]  Douglas G Altman,et al.  Treatment allocation by minimisation , 2005, BMJ : British Medical Journal.

[27]  Moors Pieter,et al.  Test-retest reliability. , 2014 .

[28]  J. Fleiss,et al.  Statistical methods for rates and proportions , 1973 .

[29]  Peter J. Kyberd,et al.  Using multiple outcome measures to determine skill level in myoelectric prosthesis use , 2011 .

[30]  L. Hermansson,et al.  Assessment of Capacity for Myoelectric Control , 2008 .

[31]  Kathleen E. Yancosek,et al.  Managing the upper extremity amputee: a protocol for success. , 2008, Journal of hand therapy : official journal of the American Society of Hand Therapists.

[32]  D. Altman,et al.  A note on the use of the intraclass correlation coefficient in the evaluation of agreement between two methods of measurement. , 1990, Computers in biology and medicine.

[33]  D. Altman,et al.  Applying the right statistics: analyses of measurement studies , 2003, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[34]  Anil K. Bhat,et al.  Prosthetic rehabilitation in traumatic upper limb amputees (an Indian perspective) , 2003, Archives of Orthopaedic and Trauma Surgery.

[35]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[36]  Jacqueline S. Hebert,et al.  Case report of modified Box and Blocks test with motion capture to measure prosthetic function. , 2012, Journal of rehabilitation research and development.

[37]  Øyvind Stavdahl,et al.  Upper Limb Prosthetic Outcome Measures (ULPOM): A Working Group and Their Findings , 2009 .

[38]  G. Guyatt,et al.  Measurement of health status. Ascertaining the minimal clinically important difference. , 1989, Controlled clinical trials.

[39]  D. Altman,et al.  Measuring agreement in method comparison studies , 1999, Statistical methods in medical research.

[40]  C. Terwee,et al.  The minimal detectable change should not replace the minimal important difference. , 2010, Journal of clinical epidemiology.

[41]  Virginia Wright,et al.  Prosthetic Outcome Measures for Use With Upper Limb Amputees: A Systematic Review of the Peer-Reviewed Literature, 1970 to 2009 , 2009 .

[42]  Nancy Black,et al.  Using potential energy to measure work related activities for persons wearing upper limb prostheses , 2005, Robotica.

[43]  H. Stassen,et al.  A field evaluation of arm prostheses for unilateral amputees , 1983, Prosthetics and orthotics international.

[44]  Jacob Cohen,et al.  The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability , 1973 .

[45]  A. M. Simon,et al.  Patient Training for Functional Use of Pattern Recognition–Controlled Prostheses , 2012, Journal of prosthetics and orthotics : JPO.

[46]  J. Weir.  Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. , 2005, Journal of strength and conditioning research.

[47]  Thomas Eckes,et al.  Introduction to Many-Facet Rasch Measurement: Analyzing and Evaluating Rater-Mediated Assessments , 2011 .

[48]  A. Ladd.  Comparison of Instruments to Assess Hand Function in Children with Radius Deficiencies , 2008 .

[49]  H. Brenner,et al.  Dependence of Weighted Kappa Coefficients on the Number of Categories , 1996, Epidemiology.

[50]  B. Wright,et al.  Construction of measures from many-facet data. , 2002, Journal of applied measurement.

[51]  D. Bonett.  Sample size requirements for estimating intraclass correlations with desired precision , 2002, Statistics in medicine.

[52]  D. Beaton,et al.  Many faces of the minimal clinically important difference (MCID): a literature review and directions for future research. , 2002, Current opinion in rheumatology.

[53]  Lennart Bodin,et al.  Intra- and inter-rater reliability of the assessment of capacity for myoelectric control. , 2006, Journal of rehabilitation medicine.