Validity, Reliability, and Sensitivity of Mobile Applications to Assess Change of Direction Speed

This study aimed to assess the validity, reliability, and sensitivity of mobile applications for assessing change-of-direction speed (CODS) performance. Thirty college athletes performed two Illinois CODS tests during one session. Assessments were carried out simultaneously using six devices (the CODTimer app, Seconds Count app, StopwatchCamera app, two analog stopwatches, and timing gates). Validity analyses included Pearson's product-moment correlation analysis, a linear regression model, and Bland-Altman plots. Reliability analyses included the intraclass correlation coefficient (ICC), the coefficient of variation (CV%), and the paired-sample t test. Sensitivity analyses included the typical error and smallest worthwhile change (SWC). The results showed that validity, reliability, and sensitivity values were higher for the CODTimer app (r = 0.99, R2 = 0.99, mean bias = −0.03 ± 0.10, CV% = 3.21, ICC = 0.89, SWC rating: good, p = 0.84) and the Seconds Count app (r = 0.99, R2 = 0.99, mean bias = −0.03 ± 0.08, CV% = 3.28, ICC = 0.88, SWC rating: good, p = 0.84) relative to the StopwatchCamera app (r = 0.98, R2 = 0.97, mean bias = −0.11 ± 0.22, CV% = 3.43, ICC = 0.86, SWC rating: marginal, p = 0.10), Analog Stopwatch 1 (r = 0.98, R2 = 0.96, mean bias = −0.09 ± 0.42, CV% = 2.95, ICC = 0.90, SWC rating: good, p = 0.91), and Analog Stopwatch 2 (r = 0.99, R2 = 0.97, mean bias = −0.12 ± 0.88, CV% = 3.51, ICC = 0.87, SWC rating: marginal, p = 0.96). In conclusion, compared to timing gates, the CODTimer app and Seconds Count app provided lower measurement bias and higher sensitivity for assessing CODS performance.

[1]  N. Šarabon,et al.  The Association between Bilateral Deficit and Athletic Performance: A Brief Review , 2022, Sports.

[2]  F. Nakamura,et al.  On-Court Change of Direction Test: an Effective Approach To Assess COD Performance in Badminton Players , 2022, Journal of human kinetics.

[3]  K. Zentgraf,et al.  Construct Validity and Applicability of a Team-Sport-Specific Change of Direction Test , 2022, Journal of human kinetics.

[4]  Yongming Li,et al.  Validity and Reliability of a Phone App and Stopwatch for the Measurement of 505 Change of Direction Performance: A Test-Retest Study Design , 2021, Frontiers in Physiology.

[5]  Filipe Manuel Clemente,et al.  Validity and Reliability of Mobile Applications for Assessing Strength, Power, Velocity, and Change-of-Direction: A Systematic Review , 2021, Sensors.

[6]  W. Young,et al.  It’s Time to Change Direction on Agility Research: a Call to Action , 2021, Sports Medicine - Open.

[7]  E. Zemková,et al.  Relationship between Physical Factors and Change of Direction Speed in Team Sports , 2021, Applied Sciences.

[8]  C. Fundarò,et al.  Use of Mobile Applications to Collect Data in Sport, Health, and Exercise Science: A Narrative Review. , 2020, Journal of strength and conditioning research.

[9]  J. J. González-Badillo,et al.  Reliability of technologies to measure the barbell velocity: Implications for monitoring resistance training , 2020, PloS one.

[10]  Israel Teoldo da Costa,et al.  The Effects of Agility Ladders on Performance: A Systematic Review , 2020, International Journal of Sports Medicine.

[11]  J. Padulo,et al.  Validity, Reliability, and Usefulness of My Jump 2 App for Measuring Vertical Jump in Primary School Children , 2020, International journal of environmental research and public health.

[12]  Chris Bishop,et al.  The validity and reliability of a novel app for the measurement of change of direction performance , 2019, Journal of sports sciences.

[13]  Carlos Balsalobre-Fernández,et al.  Use of Mobile Applications to Collect Data in Sport, Health, and Exercise Science: A Narrative Review. , 2017, Journal of strength and conditioning research.

[14]  J. Mayhew,et al.  Reliability and smallest worthwhile difference in 1RM tests according to previous resistance training experience in young women , 2017 .

[15]  A. Wright,et al.  Activity Demands During Multi-Directional Team Sports: A Systematic Review , 2017, Sports Medicine.

[16]  Robert Stanton,et al.  Validity and intra-rater reliability of MyJump app on iPhone 6s in jump performance. , 2017, Journal of science and medicine in sport.

[17]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[18]  Martin Buchheit,et al.  Sprint Running Performance Monitoring: Methodological and Practical Considerations , 2016, Sports Medicine.

[19]  Sean J. Maloney,et al.  Do stiffness and asymmetries predict change of direction performance? , 2016, Journal of sports sciences.

[20]  J. Mann,et al.  Validity and Reliability of Hand and Electronic Timing for 40-yd Sprint in College Football Players , 2015, Journal of strength and conditioning research.

[21]  B. Shultz,et al.  The Relationship between Change of Direction Speed in the Frontal Plane, Power, Reactive Strength, and Strength , 2014 .

[22]  Younes Hachana,et al.  Test-Retest Reliability, Criterion-Related Validity, and Minimal Detectable Change of the Illinois Agility Test in Male Team Sport Athletes , 2013, Journal of strength and conditioning research.

[23]  Kevin Schultz,et al.  Assessment of sprint and change-of-direction performance in college football players. , 2013, International journal of sports physiology and performance.

[24]  Patrick Bergman,et al.  Interrater Reliability and Time Measurement Validity of Speed–Agility Field Tests in Adolescents , 2011, Journal of strength and conditioning research.

[25]  S. Ahmaidi,et al.  Reliability, Usefulness, and Validity of the 30–15 Intermittent Ice Test in Young Elite Ice Hockey Players , 2011, Journal of strength and conditioning research.

[26]  Espen Tønnessen,et al.  Validity and reliability of the Newtest Powertimer 300-series® testing system , 2009, Journal of sports sciences.

[27]  Ronald K Hetzler,et al.  Reliability and Accuracy of Handheld Stopwatches Compared With Electronic Timing in Measuring Sprint Performance , 2008, Journal of strength and conditioning research.

[28]  Darren George,et al.  SPSS for Windows Step by Step: A Simple Guide and Reference , 1998 .

[29]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[30]  Robert S Gailey,et al.  Comparison of three agility tests with male servicemembers: Edgren Side Step Test, T-Test, and Illinois Agility Test. , 2013, Journal of rehabilitation research and development.

[31]  Igor Jukić,et al.  THE EFFECT OF AGILITY TRAINING ON ATHLETIC POWER PERFORMANCE , 2010 .

[32]  S. Marshall,et al.  Progressive statistics for studies in sports medicine and exercise science. , 2009, Medicine and science in sports and exercise.

[33]  Anis Chaouachi,et al.  Understanding Change of Direction Ability in Sport , 2008, Sports medicine.

[34]  Christiane,et al.  World Medical Association Declaration of Helsinki: ethical principles for medical research involving human subjects. , 2004, Journal international de bioethique = International journal of bioethics.

[35]  G Atkinson,et al.  Statistical Methods For Assessing Measurement Error (Reliability) in Variables Relevant to Sports Medicine , 1998, Sports medicine.