Reliability and validity of observational risk screening in evaluating dynamic knee valgus.

STUDY DESIGN Nonexperimental methodological study. OBJECTIVES To determine the interrater and intrarater reliability and validity of using observational risk-screening guidelines to evaluate dynamic knee valgus. BACKGROUND A deficiency in the neuromuscular control of the hip has been identified as a key risk factor for noncontact anterior cruciate ligament (ACL) injury in postpubescent females. This deficiency can manifest itself as a valgus knee alignment during tasks involving hip and knee flexion. There are currently no scientifically tested methods to screen for dynamic knee valgus in the clinic or on the field. METHODS Three physiotherapists used observational risk-screening guidelines to rate 40 adolescent female soccer players according to their risk of ACL injury. The rating was based on the amount of dynamic knee valgus observed on a drop-jump landing. Ratings were evaluated for intrarater and interrater agreement using kappa coefficients. Sensitivity and specificity of ratings were evaluated by comparing observational ratings, with measurements obtained using 3-dimensional (3-D) motion analysis. RESULTS Kappa coefficients for intrarater and interrater agreement ranged from 0.75 to 0.85, indicating that ratings were reasonably consistent over time and between physiotherapists. Sensitivity values were inadequate, ranging from 67% to 87%. This indicated that raters failed to detect up to a third of "truly high-risk" individuals. Specificity values ranged from 60% to 72%, which was considered adequate for the purposes of the screening. CONCLUSION Observational risk screening is a practical and cost-effective method of screening for ACL injury risk. Rater agreement and specificity were acceptable for this method, but sensitivity was not. To detect a greater proportion of individuals at risk of ACL injury, coaches and clinicians should ensure that they include additional tests for other high-risk characteristics in their screening protocols.

[1]  C. Mattacola,et al.  Sex Differences in Eccentric Hip-Abductor Strength and Knee-Joint Kinematics When Landing from a Jump , 2005 .

[2]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[3]  T. Hewett,et al.  Reducing knee and anterior cruciate ligament injuries among female athletes: a systematic review of neuromuscular training interventions. , 2010, The journal of knee surgery.

[4]  T. Hewett,et al.  Differential neuromuscular training effects onACL injury risk factors in"high-risk" versus "low-risk" athletes , 2007, BMC musculoskeletal disorders.

[5]  T. Hewett,et al.  A comparison of dynamic coronal plane excursion between matched male and female athletes when performing single leg landings. , 2006, Clinical biomechanics.

[6]  Stephen W Marshall,et al.  Descriptive epidemiology of collegiate women's soccer injuries: National Collegiate Athletic Association Injury Surveillance System, 1988-1989 through 2002-2003. , 2007, Journal of athletic training.

[7]  A Donner,et al.  A goodness-of-fit approach to inference procedures for the kappa statistic: confidence interval construction, significance-testing and sample size estimation. , 1992, Statistics in medicine.

[8]  Orit Shechtman,et al.  Foundations of Clinical Research: Applications to Practice, 2nd Edition, Leslie Gross Portney, Mary P. Watkins. Prentice Hall, Upper Saddle River, NJ (2000), 752 pages. $60 , 2001 .

[9]  T. Hewett,et al.  Decrease in neuromuscular control about the knee with maturation in female athletes. , 2004, The Journal of bone and joint surgery. American volume.

[10]  S A Jebb,et al.  Contribution of a sedentary lifestyle and inactivity to the etiology of overweight and obesity: current evidence and research issues. , 1999, Medicine and science in sports and exercise.

[11]  E. Waclawski.  Health Measurement Scales—A Practical Guide to Their Development and Use , 2010 .

[12]  Timothy E Hewett,et al.  Estimating 3D joint kinematics from video sequences of running and cutting maneuvers--assessing the accuracy of simple visual inspection. , 2007, Gait & posture.

[13]  Bing Yu,et al.  Lower extremity biomechanics during the landing of a stop-jump task. , 2006, Clinical biomechanics.

[14]  I. Davis,et al.  Utility of the frontal plane projection angle in females with patellofemoral pain. , 2008, The Journal of orthopaedic and sports physical therapy.

[15]  M. R. Yeadon,et al.  The appropriate use of regression equations for the estimation of segmental inertia parameters. , 1989, Journal of biomechanics.

[16]  A J van den Bogert,et al.  Evaluation of a two dimensional analysis method as a screening and evaluation tool for anterior cruciate ligament injury , 2005, British Journal of Sports Medicine.

[17]  K. Kaufman,et al.  Fate of the ACL-injured Patient , 1994, The American journal of sports medicine.

[18]  T. Hewett,et al.  Biomechanical Measures of Neuromuscular Control and Valgus Loading of the Knee Predict Anterior Cruciate Ligament Injury Risk in Female Athletes: A Prospective Study , 2005, The American journal of sports medicine.

[19]  C. Bonci.  Assessment and evaluation of predisposing factors to anterior cruciate ligament injury. , 1999, Journal of athletic training.

[20]  L. Snyder-Mackler,et al.  Interrater reliability of videotaped observational gait-analysis assessments. , 1991, Physical therapy.

[21]  D. Winter,et al.  Kinetic analysis of the lower limbs during walking: what information can be gained from a three-dimensional model? , 1995, Journal of biomechanics.

[22]  D. Winter,et al.  Trajectory of the body COG and COP during initiation and termination of gait , 1993 .

[23]  Freddie H Fu,et al.  The Effect of Direction and Reaction on the Neuromuscular and Biomechanical Characteristics of the Knee during Tasks that Simulate the Noncontact Anterior Cruciate Ligament Injury Mechanism , 2006, The American journal of sports medicine.

[24]  K. Patrick,et al.  Diet, physical activity, and sedentary behaviors as risk factors for overweight in adolescence. , 2004, Archives of pediatrics & adolescent medicine.

[25]  T. Chmielewski,et al.  Muscle strength in the lower extremity does not predict postinstruction improvements in the landing patterns of female athletes. , 2008, The Journal of orthopaedic and sports physical therapy.

[26]  Kevin R Ford,et al.  Valgus knee motion during landing in high school female and male basketball players. , 2003, Medicine and science in sports and exercise.

[27]  J. Dekker,et al.  Negative affect, pain and disability in osteoarthritis patients: the mediating role of muscle weakness. , 1993, Behaviour research and therapy.

[28]  H. Roos,et al.  The Prevalence of Gonarthrosis and Its Relation to Meniscectomy in Former Soccer Players , 1994, The American journal of sports medicine.

[29]  T. Hewett,et al.  Preparticipation Physical Examination Using a Box Drop Vertical Jump Test in Young Athletes: The Effects of Puberty and Sex , 2006, Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine.

[30]  T. Hewett,et al.  The drop-jump screening test: difference in lower limb control by gender and effect of neuromuscular training in female athletes. , 2007, The American journal of sports medicine.

[31]  W. Grove.  Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[32]  T. Hewett,et al.  Deficits in Neuromuscular Control of the Trunk Predict Knee Injury Risk , 2007, The American journal of sports medicine.

[33]  T. Rowland,et al.  Jump-Land Characteristics and Muscle Strength Development in Young Athletes: A Gender Comparison of 1140 Athletes 9 to 17 Years of AgeBarber-Westin SD, Noyes FR, Galloway M (Cincinnati Sportsmedicine Research and Education Found, Ohio) Am J Sports Med 34:375–384, 2006§ , 2007 .

[34]  Susan M Sigward,et al.  Predictors of frontal plane knee excursion during a drop land in young female soccer players. , 2008, The Journal of orthopaedic and sports physical therapy.

[35]  Willem H Meeuwisse,et al.  A Dynamic Model of Etiology in Sport Injury: The Recursive Nature of Risk and Causation , 2007, Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine.

[36]  J. Powell,et al.  Sex-Related Injury Patterns among Selected High School Sports , 2000, The American journal of sports medicine.

[37]  Stephen W Marshall,et al.  Descriptive epidemiology of collegiate men's football injuries: National Collegiate Athletic Association Injury Surveillance System, 1988-1989 through 2003-2004. , 2007, Journal of athletic training.

[38]  Knee pain in the ACL-deficient osteoarthritic knee and its relationship to quality of life. , 2003, Physiotherapy research international : the journal for researchers and clinicians in physical therapy.

[39]  D Knudson.  Validity and Reliability of Visual Ratings of the Vertical Jump , 1999, Perceptual and motor skills.

[40]  L. Snyder-Mackler,et al.  Individuals with an anterior cruciate ligament-deficient knee classified as noncopers may be candidates for nonsurgical rehabilitation. , 2008, The Journal of orthopaedic and sports physical therapy.

[41]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[42]  J A Hanson,et al.  The influence of experience on the reliability of goniometric and visual measurement of forefoot position. , 1997, The Journal of orthopaedic and sports physical therapy.

[43]  E. Arendt,et al.  Knee Injury Patterns Among Men and Women in Collegiate Basketball and Soccer , 1995, The American journal of sports medicine.

[44]  S. Blair,et al.  Effects of physical inactivity and obesity on morbidity and mortality: current evidence and research issues. , 1999, Medicine and science in sports and exercise.