Analysis of adductors angle measurement in Hammersmith infant neurological examinations using mean shift segmentation and feature point based object tracking

This paper presents image and video analysis based schemes to automate the process of adductors angle measurement which is carried out on infants as a part of Hammersmith Infant Neurological Examination (HINE). Image segmentation, thinning and feature point based object tracking are used for automating the analysis. Segmentation outputs are processed with a novel region merging algorithm. It is found that the refined segmentation outputs can successfully be used to extract features in the context of the application under consideration. Next, a heuristic based filtering algorithm is applied on the thinned structures for locating necessary points to measure adductors angle. A semi-automatic scheme based on the object tracking of a video has been proposed to minimize errors of the image based analysis. It is observed that the video-based analysis outperforms the image-based method. A fully automatic method has also been proposed and compared with the semi-automatic algorithm. The proposed methods have been tested with several videos recorded from hospitals and the results have been found to be satisfactory in the present context.

[1]  Shamik Sural,et al.  Automatic Adductors Angle Measurement for Neurological Assessment of Post-neonatal Infants during Follow Up , 2011, PReMI.

[2]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Guo Li,et al.  Tracking video objects with feature points based particle filtering , 2010, Multimedia Tools and Applications.

[4]  Xuan Jing,et al.  An efficient three-step search algorithm for block motion estimation , 2004, IEEE Transactions on Multimedia.

[5]  James M. Noras,et al.  A Novel Fast Three-Step Search Algorithm for Block-Matching Motion Estimation , 1998, ACCV.

[6]  Hiroshi Mizoguchi,et al.  Infant behavior simulation based on an environmental model and a developmental behavior model , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[7]  Narendra Ahuja,et al.  Gaussian mixture model for human skin color and its applications in image and video databases , 1998, Electronic Imaging.

[8]  Bing Han,et al.  Robust feature-based object tracking , 2007, SPIE Defense + Commercial Sensing.

[9]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Shen-Chuan Tai,et al.  Fast full-search block-matching algorithm for motion-compensated video compression , 1997, IEEE Trans. Commun..

[11]  Shamik Sural,et al.  Ball detection from broadcast soccer videos using static and dynamic features , 2008, J. Vis. Commun. Image Represent..

[12]  James M. Rehg,et al.  Statistical Color Models with Application to Skin Detection , 2004, International Journal of Computer Vision.

[13]  Hua-jun Song,et al.  Target tracking algorithm based on optical flow method using corner detection , 2011, Multimedia Tools and Applications.

[14]  Nabil Jean Naccache,et al.  SPTA: A proposed algorithm for thinning binary patterns , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[15]  B. Vohr,et al.  Neurodevelopmental and functional outcomes of extremely low birth weight infants in the National Institute of Child Health and Human Development Neonatal Research Network, 1993-1994. , 2000, Pediatrics.

[16]  A. K. Majumdar,et al.  Toward Automating Hammersmith Pulled-To-Sit Examination of Infants Using Feature Point Based Video Object Tracking , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Nikolaos G. Bourbakis,et al.  A survey of skin-color modeling and detection methods , 2007, Pattern Recognit..

[18]  Shen-Chuan Tai,et al.  Small-diamond-based search algorithm for fast block motion estimation , 2007, Signal Process. Image Commun..

[19]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[20]  Shamik Sural,et al.  A Tool for Automatic Hammersmith Infant Neurological Examination , 2011, Int. J. E Health Medical Commun..

[21]  Jue Wu,et al.  Shape-Based Image Segmentation Using Normalized Cuts , 2006, 2006 International Conference on Image Processing.

[22]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Stan Sclaroff,et al.  Skin color-based video segmentation under time-varying illumination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Li Zhang,et al.  Directional diamond search pattern for fast block motion estimation , 2003 .

[25]  Ramakant Nevatia,et al.  Human Pose Tracking in Monocular Sequence Using Multilevel Structured Models , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Henry S. Hsiao,et al.  Infant telemonitoring system , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[27]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[28]  Nai-Chung Yang,et al.  Color-Based Image Salient Region Segmentation Using Novel Region Merging Strategy , 2008, IEEE Transactions on Multimedia.

[29]  Guijin Wang,et al.  Scale and rotation invariant feature-based object tracking via modified on-line boosting , 2010, 2010 IEEE International Conference on Image Processing.

[30]  Shamik Sural,et al.  A user friendly implementation for efficiently conducting Hammersmith Infant Neurological Examination , 2010, The 12th IEEE International Conference on e-Health Networking, Applications and Services.

[31]  Matteo Cioni,et al.  Neuromotor development in infants with cerebral palsy investigated by the Hammersmith Infant Neurological Examination during the first year of age. , 2008, European journal of paediatric neurology : EJPN : official journal of the European Paediatric Neurology Society.

[32]  Mubarak Shah,et al.  Automatic recognition of baby gesture , 2003, Proceedings. 15th IEEE International Conference on Tools with Artificial Intelligence.

[33]  Andrea Guzzetta,et al.  Early neurologic assessment in preterm-infants: integration of traditional neurologic examination and observation of general movements. , 2008, European journal of paediatric neurology : EJPN : official journal of the European Paediatric Neurology Society.

[34]  Jo Yew Tham,et al.  A novel unrestricted center-biased diamond search algorithm for block motion estimation , 1998, IEEE Trans. Circuits Syst. Video Technol..

[35]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .