Modifying the Medical Research Council grading system through Rasch analyses

The Medical Research Council grading system has served through decades for the evaluation of muscle strength and has been recognized as a cardinal feature of daily neurological, rehabilitation and general medicine examination of patients, despite being respectfully criticized due to the unequal width of its response options. No study has systematically examined, through modern psychometric approach, whether physicians are able to properly use the Medical Research Council grades. The objectives of this study were: (i) to investigate physicians’ ability to discriminate among the Medical Research Council categories in patients with different neuromuscular disorders and with various degrees of weakness through thresholds examination using Rasch analysis as a modern psychometric method; (ii) to examine possible factors influencing physicians’ ability to apply the Medical Research Council categories through differential item function analyses; and (iii) to examine whether the widely used Medical Research Council 12 muscles sum score in patients with Guillain–Barré syndrome and chronic inflammatory demyelinating polyradiculoneuropathy would meet Rasch model's expectations. A total of 1065 patients were included from nine cohorts with the following diseases: Guillain–Barré syndrome (n = 480); myotonic dystrophy type-1 (n = 169); chronic inflammatory demyelinating polyradiculoneuropathy (n = 139); limb-girdle muscular dystrophy (n = 105); multifocal motor neuropathy (n = 102); Pompe's disease (n = 62) and monoclonal gammopathy of undetermined related polyneuropathy (n = 8). Medical Research Council data of 72 muscles were collected. Rasch analyses were performed on Medical Research Council data for each cohort separately and after pooling data at the muscle level to increase category frequencies, and on the Medical Research Council sum score in patients with Guillain–Barré syndrome and chronic inflammatory demyelinating polyradiculoneuropathy. Disordered thresholds were demonstrated in 74–79% of the muscles examined, indicating physicians’ inability to discriminate between most Medical Research Council categories. Factors such as physicians’ experience or illness type did not influence these findings. Thresholds were restored after rescoring the Medical Research Council grades from six to four options (0, paralysis; 1, severe weakness; 2, slight weakness; 3, normal strength). The Medical Research Council sum score acceptably fulfilled Rasch model expectations after rescoring the response options and creating subsets to resolve local dependency and item bias on diagnosis. In conclusion, a modified, Rasch-built four response category Medical Research Council grading system is proposed, resolving clinicians’ inability to differentiate among its original response categories and improving clinical applicability. A modified Medical Research Council sum score at the interval level is presented and is recommended for future studies in Guillain–Barré syndrome and chronic inflammatory demyelinating polyradiculoneuropathy.

[1]  P. Schmitz,et al.  Interobserver agreement in the assessment of muscle strength and functional abilities in Guillain‐Barré syndrome , 1991, Muscle & nerve.

[2]  R. Hughes,et al.  European Federation of Neurological Societies/Peripheral Nerve Society guideline on management of multifocal motor neuropathy * , 2006, European journal of neurology.

[3]  M. Bakkers,et al.  Rasch-built Overall Disability Scale (R-ODS) for immune-mediated peripheral neuropathies , 2011, Neurology.

[4]  April AIDS TO THE INVESTIGATION OF PERIPHERAL NERVE INJURIES , 1943 .

[5]  P. Schmitz,et al.  A randomized trial comparing intravenous immunoglobulin and plasma exchange in Guillain-Barré syndrome. , 1994, Transfusion science.

[6]  Research criteria for diagnosis of chronic inflammatory demyelinating polyneuropathy (CIDP) , 1991, Neurology.

[7]  E. Svensson Guidelines to statistical evaluation of data from rating scales and questionnaires. , 2001, Journal of rehabilitation medicine.

[8]  J. Gabriel,et al.  Paraproteinaemic Neuropathies , 1999, Bailliere's clinical neurology.

[9]  Education Division Studies in social psychology in World War II , 1949 .

[10]  S. Cuthbert,et al.  On the reliability and validity of manual muscle testing: a literature review , 2007, Chiropractic & osteopathy.

[11]  E. Nobile‐Orazio IgM paraproteinaemic neuropathies , 2004, Current opinion in neurology.

[12]  H. Smeets,et al.  Age and causes of death in adult-onset myotonic dystrophy. , 1998, Brain : a journal of neurology.

[13]  D. Altman,et al.  Statistics notes: Cronbach's alpha , 1997 .

[14]  D. Green,et al.  Critical reappraisal of Medical Research Council muscle testing for elbow flexion. , 2007, The Journal of hand surgery.

[15]  M H Liang,et al.  Evaluating measurement responsiveness. , 1995, The Journal of rheumatology.

[16]  Julie F Pallant,et al.  An introduction to the Rasch measurement model: an example using the Hospital Anxiety and Depression Scale (HADS). , 2007, The British journal of clinical psychology.

[17]  M Penta,et al.  The ABILHAND Questionnaire as a Measure of Manual Ability in Chronic Stroke Patients: Rasch-Based Validation and Relationship to Upper Limb Impairment , 2001, Stroke.

[18]  I. Merkies Evaluation of scales and measurement instruments in immune-mediated polyneuropathies , 2001 .

[19]  L. H. van den Berg,et al.  Multifocal motor neuropathy: long-term clinical and electrophysiological assessment of intravenous immunoglobulin maintenance treatment. , 2002, Brain : a journal of neurology.

[20]  Ruud W Selles,et al.  Strength measurements of the intrinsic hand muscles: a review of the development and evaluation of the Rotterdam intrinsic hand myometer. , 2006, Journal of hand therapy : official journal of the American Society of Hand Therapists.

[21]  S. Stouffer,et al.  Measurement and Prediction , 1954 .

[22]  J. Meulstee,et al.  Effect of methylprednisolone when added to standard treatment with intravenous immunoglobulin for Guillain-Barré syndrome: randomised trial , 2004, The Lancet.

[23]  P. Bergh,et al.  European Federation of Neurological Societies/Peripheral Nerve Society Guideline on management of multifocal motor neuropathy. Report of a Joint Task Force of the European Federation of Neurological Societies and the Peripheral Nerve Society – first revision , 2010, Journal of the peripheral nervous system : JPNS.

[24]  Catharina G. Faber,et al.  Rasch-built myotonic dystrophy type 1 activity and participation scale (DM1-Activ) , 2010, Neuromuscular Disorders.

[25]  Treatment of Guillain‐Barré syndrome with high‐dose immune globulins combined with methylprednisolone: A pilot study , 1994, Annals of neurology.

[26]  Jean-Louis Thonnard,et al.  ACTIVLIM: A Rasch-built measure of activity limitations in children and adults with neuromuscular disorders , 2007, Neuromuscular Disorders.

[27]  J. Beckmann,et al.  30th and 31st ENMC international workshops, Naarden, The Netherlands, Held 6–8 January 1995 , 1995, Neuromuscular Disorders.

[28]  R. Devellis Classical Test Theory , 2006, Medical care.

[29]  Alan Tennant,et al.  The Rasch measurement model in rheumatology: what is it and why use it? When should it be applied, and what should one look for in a Rasch paper? , 2007, Arthritis and rheumatism.

[30]  L. Merlini Measuring muscle strength in clinical trials , 2010, The Lancet Neurology.

[31]  J. Thonnard,et al.  Assessing and Adjusting for Cross-Cultural Validity of Impairment and Activity Limitation Scales Through Differential Item Functioning Within the Framework of the Rasch Model: The PRO-ESOR Project , 2004, Medical care.

[32]  R. Oostendorp,et al.  Manual muscle strength testing: intraobserver and interobserver reliabilities for the intrinsic muscles of the hand. , 1995, Journal of hand therapy : official journal of the American Society of Hand Therapists.

[33]  T. Prior Technical standards and guidelines for myotonic dystrophy type 1 testing , 2009, Genetics in Medicine.

[34]  John M Linacre,et al.  Optimizing rating scale category effectiveness. , 2002, Journal of applied measurement.

[35]  F. Bombelli,et al.  Multifocal motor neuropathy , 2013, Current opinion in neurology.

[36]  W. Hop,et al.  Clinical manifestation and natural course of late-onset Pompe's disease in 54 Dutch patients. , 2005, Brain : a journal of neurology.

[37]  P. Schmitz,et al.  A randomized trial comparing intravenous immune globulin and plasma exchange in Guillain-Barré syndrome. Dutch Guillain-Barré Study Group. , 1992, The New England journal of medicine.

[38]  D. Cornblath,et al.  Assessment of current diagnostic criteria for Guillain‐Barré syndrome , 1990, Annals of neurology.

[39]  A. Windebank,et al.  History of standard scoring, notation, and summation of neuromuscular signs. A current survey and recommendation , 2005, Journal of the peripheral nervous system : JPNS.

[40]  J. Linacre,et al.  Sample size and item calibration stability , 1994 .

[41]  European Federation of Neurological Societies/Peripheral Nerve Society Guideline * on management of multifocal motor neuropathy. Report of a joint task force of the European Federation of Neurological Societies and the Peripheral Nerve Society , 2006, Journal of the peripheral nervous system : JPNS.

[42]  Alan Tennant,et al.  Application of Rasch analysis in the development and application of quality of life instruments. , 2004, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[43]  Georg Rasch,et al.  Probabilistic Models for Some Intelligence and Attainment Tests , 1981, The SAGE Encyclopedia of Research Design.

[44]  Everett V. Smith Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. , 2002, Journal of applied measurement.

[45]  S. Weir Mitchell,et al.  THE TENDON-JERK AND MUSCLE-JERK IN DISEASE, AND ESPECIALLY IN POSTERIOR SCLEROSIS1 , 1886 .

[46]  J. Beckmann,et al.  The limb-girdle muscular dystrophies--proposal for a new nomenclature. , 1995, Neuromuscular disorders : NMD.

[47]  G. van Ommen,et al.  The clinical spectrum of limb girdle muscular dystrophy. A survey in The Netherlands. , 1996, Brain : a journal of neurology.

[48]  H. Hartung,et al.  Intravenous immune globulin (10% caprylate-chromatography purified) for the treatment of chronic inflammatory demyelinating polyradiculoneuropathy (ICE study): a randomised placebo-controlled trial , 2008, The Lancet Neurology.