The inter and intra rater reliability of the Netball Movement Screening Tool.

OBJECTIVES To establish the inter- and intra-rater reliability of the Netball Movement Screening Tool, for screening adolescent female netball players. DESIGN Inter- and intra-rater reliability study. METHODS Forty secondary school netball players were recruited to take part in the study. Twenty subjects were screened simultaneously and independently by two raters to ascertain inter-rater agreement. Twenty subjects were scored by rater one on two occasions, separated by a week, to ascertain intra-rater agreement. Inter and intra-rater agreement was assessed utilising the two-way mixed inter class correlation coefficient and weighted kappa statistics. RESULTS No significant demographic differences were found between the inter and intra-rater groups of subjects. Inter class correlation coefficients' demonstrated excellent inter-rater (two-way mixed inter class correlation coefficients 0.84, standard error of measurement 0.25) and intra-rater (two-way mixed inter class correlation coefficients 0.96, standard error of measurement 0.13) reliability for the overall Netball Movement Screening Tool score and substantial-excellent (two-way mixed inter class correlation coefficients 1.0-0.65) inter-rater and substantial-excellent intra-rater (two-way mixed inter class correlation coefficients 0.96-0.79) reliability for the component scores of the Netball Movement Screening Tool. Kappa statistic showed substantial to poor inter-rater (k=0.75-0.32) and intra-rater (k=0.77-0.27) agreement for individual tests of the NMST. CONCLUSIONS The Netball Movement Screening Tool may be a reliable screening tool for adolescent netball players; however the individual test scores have low reliability. The screening tool can be administered reliably by raters with similar levels of training in the tool but variable clinical experience. On-going research needs to be undertaken to ascertain whether the Netball Movement Screening Tool is a valid tool in ascertaining increased injury risk for netball players.

[1]  C. Armstrong,et al.  The reliability of the star-excursion test in assessing dynamic balance. , 1998, The Journal of orthopaedic and sports physical therapy.

[2]  Kevin R Ford,et al.  Valgus knee motion during landing in high school female and male basketball players. , 2003, Medicine and science in sports and exercise.

[3]  H. Roos,et al.  Injury risk factors in female European football. A prospective study of 123 players during one season , 2000, Scandinavian journal of medicine & science in sports.

[4]  Clare E. Milner,et al.  Test-retest reliability of knee biomechanics during stop jump landings. , 2011, Journal of biomechanics.

[5]  Janice J Eng,et al.  Reliability and validity of observational risk screening in evaluating dynamic knee valgus. , 2009, The Journal of orthopaedic and sports physical therapy.

[6]  Darin A Padua,et al.  The Landing Error Scoring System (LESS) Is a Valid and Reliable Clinical Assessment Tool of Jump-Landing Biomechanics , 2009, The American journal of sports medicine.

[7]  Kwan-Hwa Lin,et al.  Risk-factor analysis of high school basketball-player ankle injuries: a prospective controlled cohort study evaluating postural sway, ankle strength, and flexibility. , 2006, Archives of physical medicine and rehabilitation.

[8]  R Bahr,et al.  Return to play guidelines after anterior cruciate ligament surgery , 2005, British Journal of Sports Medicine.

[9]  Phillip J Plisky,et al.  Can Serious Injury in Professional Football be Predicted by a Preseason Functional Movement Screen? , 2007, North American journal of sports physical therapy : NAJSPT.

[10]  Michael D Ross,et al.  Test‐Retest Reliability of 4 Single‐Leg Horizontal Hop Tests , 2002, Journal of strength and conditioning research.

[11]  Phillip Gribble,et al.  Kinematic predictors of performance on the Star Excursion Balance Test. , 2008, Journal of sport rehabilitation.

[12]  T. Chmielewski,et al.  Intertask comparison of frontal plane knee position and moment in female athletes during three distinct movement tasks , 2011, Scandinavian journal of medicine & science in sports.

[13]  K. O’Sullivan,et al.  The effects of eccentric training on lower limb flexibility: a systematic review , 2012, British Journal of Sports Medicine.

[14]  Bruce D. Beynnon,et al.  Intratester and Intertester Reliability of Clinical Measures of Lower Extremity Anatomic Characteristics: Implications for Multicenter Studies , 2006, Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine.

[15]  L. Otago,et al.  The role of insurance data in setting priorities for netball injury prevention strategies. , 2007, Journal of science and medicine in sport.

[16]  T. Besier,et al.  Functional movement screen: inter-rater and subject reliability , 2011, British Journal of Sports Medicine.

[17]  S. Demura,et al.  Proposal for a practical star excursion balance test using three trials with four directions , 2010, Sport Sciences for Health.

[18]  Robert H. Riffenburgh,et al.  Statistics in Medicine 3rd edition , 2012 .

[19]  Jay Hertel,et al.  Simplifying the star excursion balance test: analyses of subjects with and without chronic ankle instability. , 2006, The Journal of orthopaedic and sports physical therapy.

[20]  J R Steele,et al.  Biomechanical Factors Affecting Performance in Netball , 1990, Sports medicine.

[21]  T. Hewett,et al.  Biomechanical Measures of Neuromuscular Control and Valgus Loading of the Knee Predict Anterior Cruciate Ligament Injury Risk in Female Athletes: A Prospective Study , 2005, The American journal of sports medicine.

[22]  Y. Nagano,et al.  Influence of Lower Limb Clinical Physical Measurements of Female Athletes on Knee Motion During Continuous Jump Testing , 2010 .

[23]  Bruce D. Beynnon,et al.  A Prospective Evaluation of the Landing Error Scoring System (LESS) as a Screening Tool for Anterior Cruciate Ligament Injury Risk , 2012, The American journal of sports medicine.

[24]  Bret Contreras,et al.  The Functional Movement Screen: A Review , 2014 .

[25]  Allan G. Munro,et al.  Between-session reliability of the star excursion balance test. , 2010, Physical therapy in sport : official journal of the Association of Chartered Physiotherapists in Sports Medicine.

[26]  M. Mullaney,et al.  Risk Factors for Noncontact Ankle Sprains in High School Athletes , 2006, The American journal of sports medicine.

[27]  Who Consultation on Obesity Obesity: preventing and managing the global epidemic. Report of a WHO consultation. , 2000, World Health Organization technical report series.

[28]  T. Hewett,et al.  Preparticipation Physical Examination Using a Box Drop Vertical Jump Test in Young Athletes: The Effects of Puberty and Sex , 2006, Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine.

[29]  Tim Urdan,et al.  Statistics in Plain English , 2001 .

[30]  John D. Childs,et al.  The Functional Movement Screen: a reliability study. , 2012, The Journal of orthopaedic and sports physical therapy.

[31]  B. Elliott,et al.  A descriptive epidemiology of netball injuries during competition: a five year study. , 1995, British journal of sports medicine.

[32]  T. Best,et al.  Balance As a Predictor of Ankle Injuries in High School Basketball Players , 2000, Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine.

[33]  Lindsay J. DiStefano,et al.  Reliability of the landing error scoring system-real time, a clinical assessment tool of jump-landing biomechanics. , 2011, Journal of sport rehabilitation.

[34]  S. Weldon,et al.  The efficacy of stretching for prevention of exercise-related injury: a systematic review of the literature. , 2003, Manual therapy.

[35]  Lee Burton,et al.  Interrater Reliability of the Functional Movement Screen , 2010, Journal of strength and conditioning research.

[36]  Lee Burton,et al.  Pre-participation screening: the use of fundamental movements as an assessment of function - part 1. , 2006, North American journal of sports physical therapy : NAJSPT.

[37]  Jay Hertel,et al.  Considerations for Normalizing Measures of the Star Excursion Balance Test , 2003 .

[38]  Lee Herrington,et al.  A comparison of Star Excursion Balance Test reach distances between ACL deficient patients and asymptomatic controls. , 2009, The Knee.

[39]  R. Butler,et al.  The reliability of an instrumented device for measuring components of the star excursion balance test. , 2009, North American journal of sports physical therapy : NAJSPT.

[40]  D. E. Hartig,et al.  Increasing Hamstring Flexibility Decreases Lower Extremity Overuse Injuries in Military Basic Trainees , 1999, The American journal of sports medicine.

[41]  Michael S Ferrara,et al.  The Reliability of the Modified Balance Error Scoring System , 2009, Clinical journal of sport medicine : official journal of the Canadian Academy of Sport Medicine.

[42]  J. Hertel,et al.  Intratester and Intertester Reliability during the Star Excursion Balance Tests , 2000 .

[43]  L. Engebretsen,et al.  Prevention of anterior cruciate ligament injuries in female team handball players: a prospective intervention study over three seasons , 2003, Clinical Journal of Sports Medicine.

[44]  A. Feinstein,et al.  High agreement but low kappa: I. The problems of two paradoxes. , 1990, Journal of clinical epidemiology.

[45]  Larry Katz,et al.  Intra-Rater and Inter-Rater Reliability of the Balance Error Scoring System in Pre-Adolescent School Children , 2011 .

[46]  T. Kaminski,et al.  Star Excursion Balance Test as a predictor of lower extremity injury in high school basketball players. , 2006, The Journal of orthopaedic and sports physical therapy.

[47]  Jay Smith,et al.  Intrarater and Interrater Reliability of the Balance Error Scoring System (BESS) , 2009, PM & R : the journal of injury, function, and rehabilitation.

[48]  B. Elliott,et al.  Lower Limb and Back Injury Patterns of Elite Netball Players , 1993, Sports medicine.

[49]  C. Finch,et al.  Incidence and risk factors for injury in non-elite netball. , 2006, Journal of science and medicine in sport.

[50]  Deborah J. Rumsey,et al.  Statistics for dummies , 2011 .

[51]  Bryan P Conrad,et al.  Investigation of clinician agreement in evaluating movement quality during unilateral lower extremity functional tasks: a comparison of 2 rating methods. , 2007, The Journal of orthopaedic and sports physical therapy.

[52]  Andrew Hayen,et al.  Determining the intra- and inter-observer reliability of screening tools used in sports injury research. , 2007, Journal of science and medicine in sport.

[53]  J. Hertel,et al.  Using the Star Excursion Balance Test to assess dynamic postural-control deficits and outcomes in lower extremity injury: a literature and systematic review. , 2012, Journal of athletic training.

[54]  Patria Hume,et al.  Physiotherapist agreement when visually rating movement quality during lower extremity functional screening tests. , 2012, Physical therapy in sport : official journal of the Association of Chartered Physiotherapists in Sports Medicine.

[55]  S John Sullivan,et al.  Functional movement screen normative values in a young, active population. , 2011, International journal of sports physical therapy.

[56]  Belinda Barton,et al.  Medical Statistics: A Guide to SPSS, Data Analysis and Critical Appraisal , 2005 .

[57]  J. Hertel,et al.  Efficacy of the Star Excursion Balance Tests in Detecting Reach Deficits in Subjects With Chronic Ankle Instability. , 2002, Journal of athletic training.

[58]  Epidemiology of basketball and netball injuries that resulted in hospital admission in Australia, 2000–2004 , 2009, The Medical journal of Australia.

[59]  R. Butler,et al.  Functional movement test scores improve following a standardized off‐season intervention program in professional football players , 2011, Scandinavian journal of medicine & science in sports.

[60]  P. Brukner,et al.  Clinical Sports Medicine , 1993 .

[61]  P. Gribble The Star Excursion Balance Test as a Measurement Tool , 2003 .

[62]  S. McCaw,et al.  Acute lower extremity running kinematics after a hamstring stretch. , 2012, Journal of athletic training.

[63]  Lee Burton,et al.  Pre-participation screening: the use of fundamental movements as an assessment of function - part 2. , 2006, North American journal of sports physical therapy : NAJSPT.

[64]  Caroline F. Finch,et al.  Reliability of common lower extremity musculoskeletal screening tests , 2004 .

[65]  G Atkinson,et al.  Statistical Methods For Assessing Measurement Error (Reliability) in Variables Relevant to Sports Medicine , 1998, Sports medicine.

[66]  J. Oñate,et al.  Expert versus novice interrater reliability and criterion validity of the landing error scoring system. , 2010, Journal of sport rehabilitation.

[67]  M. Kritz Development, reliability and effectiveness of the Movement Competency Screen (MCS) , 2012 .

[68]  N. Black,et al.  The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. , 1998, Journal of epidemiology and community health.

[69]  Andrew Miller,et al.  Reliable lower limb musculoskeletal profiling using easily operated, portable equipment. , 2009, Physical therapy in sport : official journal of the Association of Chartered Physiotherapists in Sports Medicine.

[70]  P. Gribble,et al.  Support for a reduction in the number of trials needed for the star excursion balance test. , 2008, Archives of physical medicine and rehabilitation.

[71]  Michael Carolan,et al.  Reliability of 2-dimensional video assessment of frontal-plane dynamic knee valgus during common athletic screening tasks. , 2012, Journal of sport rehabilitation.

[72]  D B McKeag,et al.  Single leg balance test to identify risk of ankle sprains , 2006, British Journal of Sports Medicine.

[73]  Wilma Shakespear,et al.  Netball: Steps to Success , 1997 .

[74]  K. Hauer,et al.  Test–retest reliability and minimal detectable change of repeated sit-to-stand analysis using one body fixed sensor in geriatric patients , 2012, Physiological measurement.

[75]  Stacie I Ringleb,et al.  Real-Time Intersession and Interrater Reliability of the Functional Movement Screen , 2012, Journal of strength and conditioning research.

[76]  W. Kibler,et al.  A musculoskeletal approach to the preparticipation physical examination , 1989, The American journal of sports medicine.

[77]  Kyle B. Kiesel,et al.  Biomechanical analysis of the different classifications of the Functional Movement Screen deep squat test , 2010, Sports biomechanics.

[78]  Willem H. Meeuwisse,et al.  Assessing Causation in Sport Injury: A Multifactorial Model , 1994 .

[79]  Annette Y. Karim,et al.  Inter-rater reliability of a musculoskeletal screen as administered to female professional contemporary dancers. , 2011, Work.