Early Detection of Injuries in MLB Pitchers from Video

Injuries are a major cost in sports. Teams spend millions of dollars every year on players who are hurt and unable to play, resulting in lost games, decreased fan interest and additional wages for replacement players. Modern convolutional neural networks have been successfully applied to many video recognition tasks. In this paper, we introduce the problem of injury detection/prediction in MLB pitchers and experimentally evaluate the ability of such convolutional models to detect and predict injuries in pitches only from video data. We conduct experiments on a large dataset of TV broadcast MLB videos of 20 different pitchers who were injured during the 2017 season. We experimentally evaluate the model's performance on each individual pitcher, how well it generalizes to new pitchers, how it performs for various injuries, and how early it can predict or detect an injury.

[1]  Michael S. Ryoo,et al.  Title Learning Latent Subevents in Activity Videos Using Temporal Attention Filters , 2016, AAAI.

[2]  R. Maddison,et al.  A Psychological Approach to the Prediction and Prevention of Athletic Injury , 2005 .

[3]  Michael S. Ryoo,et al.  Learning Latent Sub-events in Activity Videos Using Temporal Attention Filters , 2016, AAAI 2017.

[4]  S. Frangiamore,et al.  Latissimus Dorsi and Teres Major Injuries in Major League Baseball Pitchers: A Systematic Review. , 2016, American journal of orthopedics.

[5]  Cordelia Schmid,et al.  Action recognition by dense trajectories , 2011, CVPR 2011.

[6]  Shih-Fu Chang,et al.  CDC: Convolutional-De-Convolutional Networks for Precise Temporal Action Localization in Untrimmed Videos , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Christopher L. Camp,et al.  Injury Trends in Major League Baseball Over 18 Seasons: 1998-2015. , 2016, American journal of orthopedics.

[8]  Tim J Gabbett,et al.  Automatic Detection of Pitching and Throwing Events in Baseball With Inertial Measurement Sensors. , 2017, International journal of sports physiology and performance.

[9]  Fabio Viola,et al.  The Kinetics Human Action Video Dataset , 2017, ArXiv.

[10]  Michael S. Ryoo,et al.  Learning Latent Super-Events to Detect Multiple Activities in Videos , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Stephen Lyman,et al.  Effect of Pitch Type, Pitch Count, and Pitching Mechanics on Risk of Elbow and Shoulder Pain in Youth Baseball Pitchers , 2002, The American journal of sports medicine.

[12]  A. Hreljac.  Etiology, prevention, and early intervention of overuse injuries in runners: a biomechanical perspective. , 2005, Physical medicine and rehabilitation clinics of North America.

[13]  D. L. Falkstein.  Prediction of Athletic Injury and Postinjury Emotional Response in Collegiate Athletes: A Prospective Study of an NCAA Division I Football Team , 1999 .

[14]  Jitendra Malik,et al.  SlowFast Networks for Video Recognition , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[15]  Michael S. Ryoo,et al.  Evolving Space-Time Neural Architectures for Videos , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[16]  Michael S. Ryoo,et al.  Representation Flow for Action Recognition , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Matthew J. Hausknecht,et al.  Beyond short snippets: Deep networks for video classification , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  T. Ogino,et al.  Using sonography for the early detection of elbow injuries among young baseball players. , 2006, AJR. American journal of roentgenology.

[19]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[20]  Andrew Zisserman,et al.  Two-Stream Convolutional Networks for Action Recognition in Videos , 2014, NIPS.

[21]  Toufic R. Jildeh,et al.  Implications of Core and Hip Injuries on Major League Baseball Pitchers on the Disabled List. , 2017, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[22]  Jean M. Williams,et al.  A Model of Stress and Athletic Injury: Prediction and Prevention , 1988 .

[23]  Michael S. Ryoo,et al.  Fine-Grained Activity Recognition in Baseball Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[24]  B. Sennett,et al.  Prediction of In-Season Shoulder Injury From Preseason Testing in Division I Collegiate Football Players , 2014, Sports health.

[25]  Lorenzo Torresani,et al.  C3D: Generic Features for Video Analysis , 2014, ArXiv.

[26]  Larry H. Matthies,et al.  First-Person Activity Recognition: What Are They Doing to Me? , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Deva Ramanan,et al.  Predictive-Corrective Networks for Action Detection , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Andrew Zisserman,et al.  Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Andreas Stenling,et al.  Psychosocial Factors and Sport Injuries: Meta-analyses for Prediction and Prevention , 2017, Sports Medicine.

[31]  Joseph A. Paradiso,et al.  A Distributed Wearable, Wireless Sensor System for Evaluating Professional Baseball Pitchers and Batters , 2009, 2009 International Symposium on Wearable Computers.

[32]  Bolei Zhou,et al.  Moments in Time Dataset: One Million Videos for Event Understanding , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Andrew Zisserman,et al.  What have We Learned from Deep Representations for Action Recognition? , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[34]  A. Ryan.  Prevention of sports injuries. , 1963, The New physician.

[35]  Michael J. Black,et al.  On the Integration of Optical Flow and Action Recognition , 2017, GCPR.