Automated General Movement Assessment for Perinatal Stroke Screening in Infants

Perinatal stroke (PS) is a serious condition that often leads to life-long disability, in particular cerebral palsy (CP). Early detection and early intervention could improve motor outcome. In clinical settings, Prechtl’s general movement assessment (GMA) can be used to classify infant movements using a Gestalt approach, identifying infants at high risk of abnormal motor development. Training and maintenance of assessment skills are essential and expensive for the correct use of GMA, yet many practitioners lack these skills, preventing larger-scale screening and leading to significant risks of missing affected infants. We present an automated approach to GMA, based on body-worn accelerometers and a novel sensor data analysis method—discriminative pattern discovery (DPD)—that is designed to cope with scenarios where only coarse annotations of data are available for model training. We demonstrate the effectiveness of our approach in a study with 34 newborns (21 typically developing infants and 13 PS infants with abnormal movements). Our method is able to correctly recognise the trials with abnormal movements with at least the accuracy that is required by newly trained human annotators (75%), which is encouraging towards our ultimate goal of an automated screening system that can be used population-wide.

[1]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[2]  Patrick Olivier,et al.  Activity Recognition and Healthier Food Preparation , 2011 .

[3]  Chia-Hsiung Cheng,et al.  Effects of Repetitive Transcranial Magnetic Stimulation on Motor Functions in Patients With Stroke: A Meta-Analysis , 2012, Stroke.

[4]  Thomas Plötz,et al.  Movement Recognition Technology as a Method of Assessing Spontaneous General Movements in High Risk Infants , 2015, Front. Neurol..

[5]  Peter Andras,et al.  On preserving statistical characteristics of accelerometry data using their empirical cumulative distribution , 2013, ISWC '13.

[6]  L. Doyle,et al.  Predictive validity of spontaneous early infant movement for later cerebral palsy: a systematic review , 2018, Developmental medicine and child neurology.

[7]  A. Basu,et al.  Feasibility trial of an early therapy in perinatal stroke (eTIPS) , 2018, BMC Neurology.

[8]  E. Mercuri,et al.  Does cranial ultrasound imaging identify arterial cerebral infarction in term neonates? , 2005, Archives of Disease in Childhood - Fetal and Neonatal Edition.

[9]  Cassim Ladha,et al.  ClimbAX: skill assessment for climbing enthusiasts , 2013, UbiComp.

[10]  Diogo R. Ferreira,et al.  Preprocessing techniques for context recognition from accelerometer data , 2010, Personal and Ubiquitous Computing.

[11]  Thomas Plötz,et al.  Ensembles of Deep LSTM Learners for Activity Recognition using Wearables , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[12]  Donald J. Patterson,et al.  Augmenting gesture recognition with erlang-cox models to identify neurological disorders in premature babies , 2012, UbiComp.

[13]  Daniel Jackson,et al.  Rapid specification and automated generation of prompting systems to assist people with dementia , 2011, Pervasive Mob. Comput..

[14]  K. Goldberg,et al.  Assessment of Infant Movement With a Compact Wireless Accelerometer System , 2012 .

[15]  A. Chew,et al.  Effect of MRI on preterm infants and their families: a randomised trial with nested diagnostic and economic evaluation , 2017, Archives of Disease in Childhood: Fetal and Neonatal Edition.

[16]  A. Basu Early intervention after perinatal stroke: opportunities and challenges , 2014, Developmental medicine and child neurology.

[17]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  A. Basu,et al.  Participatory design in the development of an early therapy intervention for perinatal stroke , 2017, BMC Pediatrics.

[19]  Patrick Olivier,et al.  Beyond activity recognition: skill assessment from accelerometer data , 2015, UbiComp.

[20]  Yu Guan,et al.  Deep Learning for Human Activity Recognition in Mobile Computing , 2018, Computer.

[21]  Thomas Schmitz-Rode,et al.  Movement analysis by accelerometry of newborns and infants for the early detection of movement disorders due to infantile cerebral palsy , 2010, Medical & Biological Engineering & Computing.

[22]  Donald J. Patterson,et al.  Involuntary gesture recognition for predicting cerebral palsy in high-risk infants , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[23]  Gregory D. Abowd,et al.  Automatic Synchronization of Wearable Sensors and Video-Cameras for Ground Truth Annotation -- A Practical Approach , 2012, 2012 16th International Symposium on Wearable Computers.

[24]  K. Nelson Perinatal Ischemic Stroke , 2007, Stroke.

[25]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[26]  Patrick Olivier,et al.  The mobile fitness coach: Towards individualized skill assessment using personalized mobile devices , 2013, Pervasive Mob. Comput..

[27]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[28]  Jeffrey M. Hausdorff,et al.  Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom , 2010, IEEE Transactions on Information Technology in Biomedicine.

[29]  Richard Walker,et al.  PD Disease State Assessment in Naturalistic Environments Using Deep Learning , 2015, AAAI.

[30]  Christa Einspieler,et al.  Prechtl's assessment of general movements: a diagnostic tool for the functional assessment of the young nervous system. , 2005, Mental retardation and developmental disabilities research reviews.

[31]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[32]  S. Salerno,et al.  Is MRI imaging in pediatric age totally safe? A critical reprisal , 2018, La radiologia medica.

[33]  Bernhard Pfahringer,et al.  A Two-Level Learning Method for Generalized Multi-instance Problems , 2003, ECML.

[34]  Giovanni Cioni,et al.  Cramped synchronized general movements in preterm infants as an early marker for cerebral palsy. , 2002, Archives of pediatrics & adolescent medicine.

[35]  Gregory D. Abowd,et al.  On specialized window lengths and detector based human activity recognition , 2018, UbiComp.

[36]  Gregory D. Abowd,et al.  Adding structural characteristics to distribution-based accelerometer representations for activity recognition using wearables , 2018, UbiComp.

[37]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[38]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[39]  Gregory D. Abowd,et al.  What next, ubicomp?: celebrating an intellectual disappearing act , 2012, UbiComp.

[40]  Ann Johnson,et al.  Prevalence and characteristics of children with cerebral palsy in Europe , 2002 .