Movement Recognition Technology as a Method of Assessing Spontaneous General Movements in High Risk Infants

Preterm birth is associated with increased risks of neurological and motor impairments such as cerebral palsy. The risks are highest in those born at the lowest gestations. Early identification of those most at risk is challenging meaning that a critical window of opportunity to improve outcomes through therapy-based interventions may be missed. Clinically, the assessment of spontaneous general movements is an important tool, which can be used for the prediction of movement impairments in high risk infants. Movement recognition aims to capture and analyze relevant limb movements through computerized approaches focusing on continuous, objective, and quantitative assessment. Different methods of recording and analyzing infant movements have recently been explored in high risk infants. These range from camera-based solutions to body-worn miniaturized movement sensors used to record continuous time-series data that represent the dynamics of limb movements. Various machine learning methods have been developed and applied to the analysis of the recorded movement data. This analysis has focused on the detection and classification of atypical spontaneous general movements. This article aims to identify recent translational studies using movement recognition technology as a method of assessing movement in high risk infants. The application of this technology within pediatric practice represents a growing area of inter-disciplinary collaboration, which may lead to a greater understanding of the development of the nervous system in infants at high risk of motor impairment.

[1]  A. Whitelaw,et al.  Movement outcomes of infants born moderate and late preterm , 2013, Acta paediatrica.

[2]  A. Spittle How do we use the assessment of general movements in clinical practice? , 2011, Developmental medicine and child neurology.

[3]  Gregory D. Abowd,et al.  Automatic Synchronization of Wearable Sensors and Video-Cameras for Ground Truth Annotation -- A Practical Approach , 2012, 2012 16th International Symposium on Wearable Computers.

[4]  J. Bosma,et al.  Cervical accelerometry in preterm infants. , 2002, Developmental medicine and child neurology.

[5]  J. Skranes,et al.  Assessment of motor behaviour in high-risk-infants at 3 months predicts motor and cognitive outcomes in 10 years old children. , 2013, Early human development.

[6]  Christa Einspieler,et al.  Prechtl's assessment of general movements: a diagnostic tool for the functional assessment of the young nervous system. , 2005, Mental retardation and developmental disabilities research reviews.

[7]  L. Doyle,et al.  General Movements in Very Preterm Children and Neurodevelopment at 2 and 4 Years , 2013, Pediatrics.

[8]  H. Prechtl Qualitative changes of spontaneous movements in fetus and preterm infant are a marker of neurological dysfunction. , 1990, Early human development.

[9]  Gentaro Taga,et al.  Jerky spontaneous movements at term age in preterm infants who later developed cerebral palsy. , 2014, Early human development.

[10]  Hartmut Dickhaus,et al.  Kinematic assessment of stereotypy in spontaneous movements in infants. , 2012, Gait & posture.

[11]  Gentaro Taga,et al.  Increasing selectivity of interlimb coordination during spontaneous movements in 2- to 4-month-old infants , 2012, Experimental Brain Research.

[12]  A. Jensenius,et al.  Early prediction of cerebral palsy by computer‐based video analysis of general movements: a feasibility study , 2010, Developmental medicine and child neurology.

[13]  Satoru Morita,et al.  A Dynamical Systems Analysis of Spontaneous Movements in Newborn Infants , 2007, Journal of motor behavior.

[14]  Matthias Kranz,et al.  GymSkill: A personal trainer for physical exercises , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications.

[15]  Matthew S. Goodwin,et al.  Automated Detection of Stereotypical Motor Movements , 2011, Journal of autism and developmental disorders.

[16]  R. Ware,et al.  A systematic review of tests to predict cerebral palsy in young children , 2013, Developmental medicine and child neurology.

[17]  B. Bloem,et al.  Quantitative wearable sensors for objective assessment of Parkinson's disease , 2013, Movement disorders : official journal of the Movement Disorder Society.

[18]  Parsa Rahmanpour,et al.  Features for Movement based Prediction of Cerebral Palsy , 2009 .

[19]  A. Majnemer,et al.  Predictive validity of Prechtl’s Method on the Qualitative Assessment of General Movements: a systematic review of the evidence , 2011, Developmental medicine and child neurology.

[20]  Nicholas Wickström,et al.  A Wearable Accelerometer Based Platform to Encourage Physical Activity for the Elderly , 2008 .

[21]  Peter Andras,et al.  On preserving statistical characteristics of accelerometry data using their empirical cumulative distribution , 2013, ISWC '13.

[22]  Thomas Schmitz-Rode,et al.  Movement analysis by accelerometry of newborns and infants for the early detection of movement disorders due to infantile cerebral palsy , 2010, Medical & Biological Engineering & Computing.

[23]  Patrick Olivier,et al.  The mobile fitness coach: Towards individualized skill assessment using personalized mobile devices , 2013, Pervasive Mob. Comput..

[24]  M. Hadders‐Algra,et al.  Computer‐based analysis of general movements reveals stereotypies predicting cerebral palsy , 2014, Developmental medicine and child neurology.

[25]  Giovanni Cioni,et al.  Early markers for cerebral palsy: insights from the assessment of general movements , 2012 .

[26]  Hartmut Dickhaus,et al.  Quantification of the segmental kinematics of spontaneous infant movements. , 2008, Journal of biomechanics.

[27]  Cassim Ladha,et al.  ClimbAX: skill assessment for climbing enthusiasts , 2013, UbiComp.

[28]  G Rau,et al.  Movement analysis in the early detection of newborns at risk for developing spasticity due to infantile cerebral palsy. , 2006, Human movement science.

[29]  David Windridge,et al.  Lattice-Based Anomaly Rectification for Sport Video Annotation , 2010, 2010 20th International Conference on Pattern Recognition.

[30]  Agata Rozga,et al.  Automatic assessment of problem behavior in individuals with developmental disabilities , 2012, UbiComp.

[31]  Irfan A. Essa,et al.  Augmenting Bag-of-Words: Data-Driven Discovery of Temporal and Structural Information for Activity Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  J. Affeldt,et al.  The feasibility study , 2019, The Information System Consultant’s Handbook.

[33]  E. Thelen Origins of origins of motor control , 1995, Behavioral and Brain Sciences.

[34]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[35]  R. Horne,et al.  The use of actigraphy for assessment of the development of sleep/wake patterns in infants during the first 12 months of life , 2007, Journal of sleep research.

[36]  Cassim Ladha,et al.  Dog's life: wearable activity recognition for dogs , 2013, UbiComp.

[37]  Patrick Boissy,et al.  Accelerometer-based wireless body area network to estimate intensity of therapy in post-acute rehabilitation , 2008, Journal of NeuroEngineering and Rehabilitation.

[38]  Sourav Bhattacharyaa,et al.  Towards Using Unlabeled Data in a Sparse-coding Framework for Human Activity Recognition , 2014 .

[39]  H. Prechtl,et al.  State of the art of a new functional assessment of the young nervous system. An early predictor of cerebral palsy. , 1997, Early human development.

[40]  Gentaro Taga,et al.  Specific characteristics of spontaneous movements in preterm infants at term age are associated with developmental delays at age 3 years , 2013, Developmental medicine and child neurology.

[41]  Thomas Schmitz-Rode,et al.  Introduction of a method for quantitative evaluation of spontaneous motor activity development with age in infants , 2012, Experimental Brain Research.

[42]  David Windridge,et al.  A framework for automatic sports video annotation with anomaly detection and transfer learning , 2013 .

[43]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[44]  A. Okely,et al.  Methodological considerations in using accelerometers to assess habitual physical activity in children aged 0-5 years. , 2009, Journal of science and medicine in sport.

[45]  Alexander Refsum Jensenius,et al.  Using computer-based video analysis in the study of fidgety movements. , 2009, Early human development.

[46]  Marlette Burger,et al.  The predictive validity of general movements--a systematic review. , 2009, European journal of paediatric neurology : EJPN : official journal of the European Paediatric Neurology Society.

[47]  David Windridge,et al.  Anomaly Detection and Knowledge Transfer in Automatic Sports Video Annotation , 2012, Detection and Identification of Rare Audiovisual Cues.

[48]  Chris Button,et al.  A Review of Vision-Based Motion Analysis in Sport , 2008, Sports medicine.

[49]  David Windridge,et al.  Multilevel Chinese Takeaway Process and Label-Based Processes for Rule Induction in the Context of Automated Sports Video Annotation , 2014, IEEE Transactions on Cybernetics.

[50]  G. ÓLaighin,et al.  Direct measurement of human movement by accelerometry. , 2008, Medical engineering & physics.

[51]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[52]  Lars Adde,et al.  Inter-observer reliability of the "Assessment of Motor Repertoire--3 to 5 Months" based on video recordings of infants. , 2009, Early human development.

[53]  Tao Liu,et al.  Gait Analysis Using Wearable Sensors , 2012, Sensors.

[54]  Daniel Jackson,et al.  Occupancy monitoring using environmental & context sensors and a hierarchical analysis framework , 2014, BuildSys@SenSys.

[55]  Daniel Roggen,et al.  Automatic correction of annotation boundaries in activity datasets by class separation maximization , 2013, UbiComp.

[56]  Øyvind Stavdahl,et al.  ENIGMA - Enhanced interactive general movement assessment , 2008, Expert Syst. Appl..

[57]  Thomas Plötz,et al.  Using unlabeled data in a sparse-coding framework for human activity recognition , 2014, Pervasive Mob. Comput..

[58]  Satoru Morita,et al.  Time Series Analysis of Spontaneous Upper-Extremity Movements of Premature Infants With Brain Injuries , 2008, Physical Therapy.

[59]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[60]  V. Pierrat,et al.  Computer‐based analysis of general movements reveals stereotypies predicting cerebral palsy , 2014, Developmental medicine and child neurology.

[61]  Yao-Jen Chang,et al.  A Kinect-based upper limb rehabilitation system to assist people with cerebral palsy. , 2013, Research in developmental disabilities.

[62]  K. Goldberg,et al.  Assessment of Infant Movement With a Compact Wireless Accelerometer System , 2012 .

[63]  J. Nicholl,et al.  A systematic review of the evidence , 2022 .

[64]  Pier Luca Lanzi,et al.  Fast feature selection with genetic algorithms: a filter approach , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[65]  N. Marlow,et al.  Neurological and developmental outcome in extremely preterm children born in England in 1995 and 2006: the EPICure studies , 2012, BMJ : British Medical Journal.

[66]  A. Spittle,et al.  Cerebral palsy and developmental coordination disorder in children born preterm. , 2014, Seminars in fetal & neonatal medicine.

[67]  Li-Chen Fu,et al.  Gesture stroke recognition using computer vision and linear accelerometer , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[68]  S. Jawaid The Global Action Report on Preterm Birth , 2012 .

[69]  Patrick Olivier,et al.  Feature Learning for Activity Recognition in Ubiquitous Computing , 2011, IJCAI.

[70]  Mijna Hadders-Algra,et al.  Variation and Variability: Key Words in Human Motor Development , 2010, Physical Therapy.

[71]  Laura Luna-Oliva,et al.  Kinect Xbox 360 as a therapeutic modality for children with cerebral palsy in a school environment: a preliminary study. , 2013, NeuroRehabilitation.

[72]  Maja Steinlin,et al.  Correlation properties of spontaneous motor activity in healthy infants: a new computer-assisted method to evaluate neurological maturation , 2013, Experimental Brain Research.

[73]  Luc Van Gool,et al.  Detection and Identification of Rare Audiovisual Cues , 2012, Studies in Computational Intelligence.

[74]  Donald J. Patterson,et al.  Augmenting gesture recognition with erlang-cox models to identify neurological disorders in premature babies , 2012, UbiComp.

[75]  Joy E. Lawn,et al.  Born too soon: the global action report on preterm birth , 2012 .

[76]  David Windridge,et al.  Ball event recognition using hmm for automatic tennis annotation , 2010, 2010 IEEE International Conference on Image Processing.