Validity, Reliability and Sensitivity of Measures of Sporting Performance

Performance testing is one of the most common and important measures used in sports science and physiology. Performance tests allow for a controlled simulation of sports and exercise performance for research or applied science purposes. There are three factors that contribute to a good performance test: (i) validity; (ii) reliability; and (iii) sensitivity. A valid protocol is one that resembles the performance that is being simulated as closely as possible. When investigating race-type events, the two most common protocols are time to exhaustion and time trials. Time trials have greater validity than time to exhaustion because they provide a good physiological simulation of actual performance and correlate with actual performance. Sports such as soccer are more difficult to simulate. While shuttle-running protocols such as the Loughborough Intermittent Shuttle Test may simulate physiology of soccer using time to exhaustion or distance covered, it is not a valid measure of soccer performance. There is a need to include measures of skill in such protocols. Reliability is the variation of a protocol. Research has shown that time-to-exhaustion protocols have a coefficient of variation (CV) of >10%, whereas time trials are more reliable as they have been shown to have a CV of <5%. A sensitive protocol is one that is able to detect small, but important, changes in performance. The difference between finishing first and second in a sporting event is <1%. Therefore, it is important to be able to detect small changes with performance protocols. A quantitative value of sensitivity may be accomplished through the signal : noise ratio, where the signal is the percentage improvement in performance and the noise is the CV.

[1]  V. Billat,et al.  Reproducibility of running time to exhaustion at VO2max in subelite runners. , 1994, Medicine and science in sports and exercise.

[2]  Clyde Williams,et al.  The Loughborough Intermittent Shuttle Test: A field test that simulates the activity pattern of soccer , 2000, Journal of sports sciences.

[3]  Asker E Jeukendrup,et al.  Carbohydrate intake during exercise and performance. , 2004, Nutrition.

[4]  A. Aziz,et al.  Reproducibility of outdoor flat and uphill cycling time trials and their performance correlates with peak power output in moderately trained cyclists. , 2005, Journal of sports science & medicine.

[5]  Stephen H. Boutcher,et al.  The Effects of Sensory Deprivation and Music on Perceived Exertion and Affect During Exercise , 1990 .

[6]  Matthew Weston,et al.  Analysis of physical match performance in English Premier League soccer referees with particular reference to first half and player work rates. , 2007, Journal of science and medicine in sport.

[7]  A. J. W. U. statement Joint position statement: nutrition and athletic performance , 2001 .

[8]  G Atkinson,et al.  Effects of music on work-rate distribution during a cycling time trial. , 2004, International journal of sports medicine.

[9]  G Atkinson,et al.  Statistical Methods For Assessing Measurement Error (Reliability) in Variables Relevant to Sports Medicine , 1998, Sports medicine.

[10]  A. Jeukendrup,et al.  Effects of pre-exercise ingestion of trehalose, galactose and glucose on subsequent metabolism and cycling performance , 2002, European Journal of Applied Physiology.

[11]  W. Vincent Statistics In Kinesiology , 1994 .

[12]  W G Hopkins,et al.  Variability of competitive performance of distance runners. , 2001, Medicine and science in sports and exercise.

[13]  Hirofumi Tanaka,et al.  Day to Day Variation in Time Trial Cycling Performance , 1992, International journal of sports medicine.

[14]  David P. Swain,et al.  Physiological effects of constant versus variable power during endurance cycling. , 1998 .

[15]  A. Jeukendrup,et al.  Should time trial performance be predicted from three serial time-to-exhaustion tests? , 2005, Medicine and science in sports and exercise.

[16]  J Mark Davis,et al.  Carbohydrates and physical/mental performance during intermittent exercise to fatigue. , 2002, Medicine and science in sports and exercise.

[17]  Sergej M Ostojic,et al.  Effects of a carbohydrate-electrolyte drink on specific soccer tests and performance. , 2002, Journal of sports science & medicine.

[18]  J A Hawley,et al.  Pacing strategy in simulated cycle time-trials is based on perceived rather than actual distance. , 2001, Journal of science and medicine in sport.

[19]  Kate Hodges,et al.  Pseudoephedrine enhances performance in 1500-m runners. , 2006, Medicine and science in sports and exercise.

[20]  W G Hopkins,et al.  Measures of Reliability in Sports Medicine and Science , 2000, Sports medicine.

[21]  W. Dawson American College of Sports Medicine, American Dietetic Association, and Dietitians of Canada: Nutrition and athletic performance (joint position statement) , 2002 .

[22]  T. Noakes,et al.  Improved athletic performance in highly trained cyclists after interval training. , 1996, Medicine and science in sports and exercise.

[23]  Jonathan M Peake,et al.  Interval training program optimization in highly trained endurance cyclists. , 2002, Medicine and science in sports and exercise.

[24]  C. Shing,et al.  Reproducibility of a laboratory-based 40-km cycle time-trial on a stationary wind-trainer in highly trained cyclists. , 2003, International journal of sports medicine.

[25]  K. Purcell A tennis forehand-backhand drive skill test which measures ball control and stroke firmness. , 1981, Research quarterly for exercise and sport.

[26]  W G Hopkins,et al.  Ergometer error and biological variation in power output in a performance test with three cycle ergometers. , 2006, International journal of sports medicine.

[27]  R. Thatcher,et al.  Development and validation of a sport-specific exercise protocol for elite youth soccer players. , 2004, The Journal of sports medicine and physical fitness.

[28]  A E Jeukendrup,et al.  Improving Cycling Performance , 2001, Sports medicine.

[29]  A Practical Tennis Serve Test: Measurement of Skill under Simulated Game Conditions , 1979 .

[30]  R. Lovell,et al.  Physiological and Mechanical Response to Soccer-Specific Intermittent Activity and Steady-State Activity , 2006, Research in sports medicine.

[31]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[32]  R. Davison,et al.  Reliability of a combined 3-min constant load and performance cycling test. , 2003, International Journal of Sports Medicine.

[33]  W G Hopkins,et al.  Tests of Cycling Performance , 2001, Sports medicine.

[34]  U. Wisløff,et al.  Aerobic endurance training improves soccer performance. , 2001, Medicine and science in sports and exercise.

[35]  A Jeukendrup,et al.  A new validated endurance performance test. , 1996, Medicine and science in sports and exercise.

[36]  Will G. Hopkins,et al.  A new reliable laboratory test of endurance performance for road cyclists. , 1998, Medicine and science in sports and exercise.

[37]  C. Willíams,et al.  The influence of pre-exercise glucose ingestion on endurance running capacity. , 1994, British journal of sports medicine.

[38]  A. Williams,et al.  Perceptual skill in soccer: Implications for talent identification and development , 2000, Journal of sports sciences.

[39]  Peter Krustrup,et al.  The Yo-Yo IR2 test: physiological response, reliability, and application to elite soccer. , 2006, Medicine and science in sports and exercise.

[40]  Bruce Elliott,et al.  The RowPerfect ergometer: a training aid for on-water single scull rowing. , 2002, Sports biomechanics.

[41]  D. Costill,et al.  Carbohydrate feedings and exercise performance: effect of initial muscle glycogen concentration. , 1993, Journal of applied physiology.

[42]  Peter Krustrup,et al.  The yo-yo intermittent recovery test: physiological response, reliability, and validity. , 2003, Medicine and science in sports and exercise.

[43]  C. Willíams,et al.  Influence of fluid intake on endurance running performance , 2004, European Journal of Applied Physiology and Occupational Physiology.

[44]  T D Noakes,et al.  Heart rate responses during a 4-d cycle stage race. , 1994, Medicine and science in sports and exercise.

[45]  J Bangsbo,et al.  Comparison of Various Exercise Tests with Endurance Performance during Soccer in Professional Players , 1992, International journal of sports medicine.

[46]  E. Rampinini,et al.  Validity of Simple Field Tests as Indicators of Match-Related Physical Performance in Top-Level Professional Soccer Players , 2006, International journal of sports medicine.

[47]  Will G Hopkins,et al.  Reliability of time to exhaustion analyzed with critical-power and log-log modeling. , 2005, Medicine and science in sports and exercise.

[48]  Iñigo Mujika,et al.  Acute creatine supplementation and performance during a field test simulating match play in elite female soccer players. , 2002, International journal of sport nutrition and exercise metabolism.

[49]  R. Maughan,et al.  Effects of fluid, electrolyte and substrate ingestion on endurance capacity , 2006, European Journal of Applied Physiology and Occupational Physiology.

[50]  V. Di Salvo,et al.  Performance Characteristics According to Playing Position in Elite Soccer , 2006, International journal of sports medicine.

[51]  E. Coyle,et al.  Metabolism and performance following carbohydrate ingestion late in exercise. , 1989, Medicine and science in sports and exercise.

[52]  R. Davison,et al.  Reliability of Mean Power Recorded During Indoor and Outdoor Self-Paced 40 km Cycling Time-Trials , 2001, International journal of sports medicine.

[53]  K. Nosaka,et al.  Reliability of time-to-exhaustion versus time-trial running tests in runners. , 2007, Medicine and science in sports and exercise.

[54]  K. Jensen,et al.  Reproducibility and validity of physiological parameters measured in cyclists riding on racing bikes placed on a stationary magnetic brake , 1998, Scandinavian journal of medicine & science in sports.

[55]  P. Terry,et al.  THE PSYCHOPHYSICAL EFFECTS OF MUSIC IN SPORT AND EXERCISE: A REVIEW , 1997 .

[56]  R. Pate,et al.  Carbohydrate-electrolyte drinks: effects on endurance cycling in the heat. , 1988, The American journal of clinical nutrition.

[57]  W G Hopkins,et al.  Reproducibility of self-paced treadmill performance of trained endurance runners. , 1998, International journal of sports medicine.

[58]  L Szmedra,et al.  Effect of Music on Perceived Exertion, Plasma Lactate, Norepinephrine and Cardiovascular Hemodynamics during Treadmill Running , 1998, International journal of sports medicine.

[59]  F. Hettinga,et al.  The effect of extrinsic motivation on cycle time trial performance. , 2007, Medicine and science in sports and exercise.

[60]  Romain Meeusen,et al.  Time course of performance changes and fatigue markers during intensified training in trained cyclists. , 2002, Journal of applied physiology.

[61]  T Reilly,et al.  Physiological responses to laboratory-based soccer-specific intermittent and continuous exercise , 2000, Journal of sports sciences.

[62]  R M Nicholson,et al.  Indices of lactate threshold and their relationship with 10-km running velocity. , 2001, Medicine and science in sports and exercise.

[63]  C. Castagna,et al.  Variation in top level soccer match performance. , 2007, International journal of sports medicine.

[64]  P. Krustrup,et al.  Match performance of high-standard soccer players with special reference to development of fatigue , 2003, Journal of sports sciences.

[65]  T D Noakes,et al.  Assessment of the Reproducibility of Performance Testing on an Air-Braked Cycle Ergometer , 1996, International journal of sports medicine.

[66]  F. Marino,et al.  Effect of Deception of Distance on Prolonged Cycling Performance , 2004, Perceptual and motor skills.

[67]  R. Wilber,et al.  Influence of carbohydrate ingestion on blood glucose and performance in runners. , 1992, International journal of sport nutrition.

[68]  V M Nethery,et al.  Competition between internal and external sources of information during exercise: influence on RPE and the impact of the exercise load. , 2002, The Journal of sports medicine and physical fitness.

[69]  T. Reilly A motion analysis of work-rate in different positional roles in professional football match-play , 1976 .

[70]  P. K. Pedersen,et al.  Biological variation in variables associated with exercise training. , 2003, International journal of sports medicine.

[71]  J. Vogel,et al.  Endurance exercise: effect of work-rest schedules and repeated testing. , 1971, Journal of applied physiology.

[72]  J. K. Nelson,et al.  Research Methods in Physical Activity , 1990 .

[73]  W G Hopkins,et al.  Reliability of Power in Physical Performance Tests , 2001, Sports medicine.

[74]  A J Spaepen,et al.  Evaluation of stroke performance in tennis. , 1998, Medicine and science in sports and exercise.

[75]  W G Hopkins,et al.  High reliability of performance of well-trained rowers on a rowing ergometer. , 1999, Journal of sports sciences.

[76]  T J Pujol,et al.  Influence of Music on Wingate Anaerobic Test Performance , 1999, Perceptual and motor skills.

[77]  A. Jeukendrup,et al.  Carbohydrate supplementation improves moderate and high-intensity exercise in the heat , 2003, Pflügers Archiv.

[78]  T. Reilly,et al.  Science and football: a review of applied research in the football codes , 2003, Journal of sports sciences.

[79]  T D Noakes,et al.  Metabolic and performance responses to constant-load vs. variable-intensity exercise in trained cyclists. , 1999, Journal of applied physiology.

[80]  Patria A Hume,et al.  Reliability of power output during rowing changes with ergometer type and race distance. , 2004, Sports biomechanics.

[81]  C. Willíams,et al.  The influence of intermittent high-intensity shuttle running and fluid ingestion on the performance of a soccer skill. , 1999, Journal of sports sciences.

[82]  J. Taunton,et al.  Relationship of exercise test variables to cycling performance in an Ironman triathlon , 2002, European Journal of Applied Physiology.

[83]  T. Noakes,et al.  Peak power output predicts maximal oxygen uptake and performance time in trained cyclists , 2005, European Journal of Applied Physiology and Occupational Physiology.

[84]  A. Jeukendrup,et al.  Carbohydrate-Electrolyte Feedings Improve 1 h Time Trial Cycling Performance , 1997, International journal of sports medicine.

[85]  W G Hopkins,et al.  Design and analysis of research on sport performance enhancement. , 1999, Medicine and science in sports and exercise.

[86]  T D Noakes,et al.  A signalling role for muscle glycogen in the regulation of pace during prolonged exercise , 2004, British Journal of Sports Medicine.

[87]  T M McLellan,et al.  Variability of time to exhaustion during submaximal exercise. , 1995, Canadian journal of applied physiology = Revue canadienne de physiologie appliquee.

[88]  G. Abt,et al.  The effect of a high-carbohydrate diet on the skill performance of midfield soccer players after intermittent treadmill exercise. , 1998, Journal of science and medicine in sport.

[89]  T D Noakes,et al.  Evidence for complex system integration and dynamic neural regulation of skeletal muscle recruitment during exercise in humans , 2004, British Journal of Sports Medicine.

[90]  D. Bishop,et al.  Reliability of a 1-h endurance performance test in trained female cyclists. , 1997, Medicine and science in sports and exercise.

[91]  B. Kiens,et al.  Effects of glucose, glucose plus branched-chain amino acids, or placebo on bike performance over 100 km. , 1996, Journal of applied physiology.

[92]  John Eldred,et al.  Reliability and validity of two tests of soccer skill , 2007, Journal of sports sciences.

[93]  A. Jeukendrup,et al.  Reliability of a cycling time trial in a glycogen-depleted state , 2006, European Journal of Applied Physiology.

[94]  D. Costill,et al.  Biological and Technological Variability of Three Anaerobic Ergometer Tests , 1984, International journal of sports medicine.

[95]  T D Noakes,et al.  The effect of carbohydrate ingestion on the motor skill proficiency of soccer players. , 1996, International journal of sport nutrition.

[96]  E. Ravussin,et al.  Reproducibility of endurance performance on a treadmill using a preloaded time trial. , 2004, Medicine and science in sports and exercise.

[97]  G. Atkinson Sport performance: variable or construct? , 2002, Journal of sports sciences.

[98]  C Foster,et al.  Physiological responses during simulated competition. , 1993, Medicine and science in sports and exercise.

[99]  I. Mujika,et al.  ACUTE CREATINE SUPPLEMENTATION AND PERFORMANCE DURING A FIELD TEST SIMULATING MATCH PLAY IN ELITE FEMALE SOCCER PLAYERS , 2001 .

[100]  Di Salvo Valter,et al.  Validation of Prozone ®: A new video-based performance analysis system , 2006 .