Video processing-based detection of neonatal seizures by trajectory features clustering

In this paper, we present a novel approach to early diagnosis, through a video processing-based approach, of the presence of neonatal seizures. In particular, image processing and gesture recognition techniques are first used to characterize typical gestures of neonatal seizures. More precisely, gesture trajectories are characterized by extracting some relevant features. In particular, selecting the point with the maximum amplitude of the optical flow vector of the video frame sequence, during a newborn movement, is selected and then tracked through an algorithm based on template matching and optical flow. The observed features are then clustered using the Density-Based Spatial Clustering of Applications with Noise (DBSCAN) algorithm. The proposed approach allows to efficiently differentiate pathological repetitive movements (e.g., clonic and subtle seizures) from random ones.

[1]  Roberto Brunelli,et al.  Template Matching Techniques in Computer Vision: Theory and Practice , 2009 .

[2]  G. Ronen,et al.  The epidemiology of clinical neonatal seizures in Newfoundland: a population-based study. , 1999, The Journal of pediatrics.

[3]  Mostefa Mesbah,et al.  Newborn EEG seizure pattern characterisation using time-frequency analysis , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[4]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[5]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Nicolaos B. Karayiannis,et al.  Extraction of motion strength and motor activity signals from video recordings of neonatal seizures , 2001, IEEE Transactions on Medical Imaging.

[7]  George Kollios,et al.  Extraction and clustering of motion trajectories in video , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[8]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[9]  M.K. Bhuyan,et al.  Feature Extraction from 2D Gesture Trajectory in Dynamic Hand Gesture Recognition , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[10]  S. Seri,et al.  Preterm infants with video-EEG confirmed seizures: Outcome at 30 months of age , 2008, Brain and Development.

[11]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[12]  Gianluigi Ferrari,et al.  Low-complexity image processing for real-time detection of neonatal clonic seizures , 2010 .

[13]  Gianluigi Ferrari,et al.  Extraction of video features for real-time detection of neonatal seizures , 2011, 2011 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.

[14]  Eli M. Mizrahi,et al.  Characterization and classification of neonatal seizures , 1987, Neurology.

[15]  Roberto Brunelli,et al.  Advanced , 1980 .