Learning-based Detection and Tracking in Medical Imaging : A Robust Information-Fusion Approach

Medical image processing tools are playing an increasingly important role in assisting the clinicians in diagnosis, therapy planning and image-guided interventions. Accurate, robust and fast tracking of deformable anatomical objects such as the heart, is a crucial task in medical image analysis. One of the main challenges is to maintain an anatomically consistent representation of target appearance that is robust enough to cope with inherent changes due to target movement, imaging device movement, varying imaging conditions and is consistent with the domain expert clinical knowledge. To address these challenges this chapter presents a robust learning-based fusion framework that relies on anatomically indexed componentbased object models that integrate several sources of information to determine the temporal trajectory of the deformable target. Large annotated imaging databases are exploited to encode the domain knowledge in shape models and motion models and to learn discriminative image classifiers for the target appearance. The framework robustly fuses the prior information with traditional tracking approaches based on template matching and registration. We demonstrate various medical image analysis applications with focus on cardiology such as 2D auto left heart, catheter detection and tracking, 3D cardiac chambers surface tracking, and 4D complex cardiac structure tracking, in multiple modalities including Ultrasound (US), Cardiac Computed Tomography (CT), Magnetic Resonance Imaging (MRI), and X-ray fluoroscopy.

[1]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[3]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Timothy F. Cootes,et al.  Face Recognition Using Active Appearance Models , 1998, ECCV.

[5]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[6]  James D. Thomas,et al.  Segmentation and tracking in echocardiographic sequences: active contours guided by optical flow estimates , 1998, IEEE Transactions on Medical Imaging.

[7]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[8]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[9]  David J. Fleet,et al.  Stochastic Tracking of 3D Human Figures Using 2D Image Motion , 2000, ECCV.

[10]  Hai Tao,et al.  Dynamic layer representation with applications to tracking , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  Timothy F. Cootes,et al.  Statistical models of appearance for medical image analysis and computer vision , 2001, SPIE Medical Imaging.

[12]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  J. Alison Noble,et al.  A shape-space-based approach to tracking myocardial borders and quantifying regional left-ventricular function applied in echocardiography , 2002, IEEE Transactions on Medical Imaging.

[14]  Ramakant Nevatia,et al.  3D tracking of human locomotion: a tracking as recognition approach , 2002, Object recognition supported by user interaction for service robots.

[15]  Dorin Comaniciu,et al.  Nonparametric information fusion for motion estimation , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[16]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Chandra Kambhamettu,et al.  A Coarse-to-Fine Deformable Contour Optimization Framework , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Dorin Comaniciu,et al.  Real-Time Multi-model Tracking of Myocardium in Echocardiography Using Robust Information Fusion , 2004, MICCAI.

[19]  Lihi Zelnik-Manor,et al.  Temporal Factorization vs. Spatial Factorization , 2004, ECCV.

[20]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[21]  Zhuowen Tu,et al.  Probabilistic boosting-tree: learning discriminative models for classification, recognition, and clustering , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  Shehzad Khalid,et al.  Motion Trajectory Learning in the DFT-Coefficient Feature Space , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[23]  Narendra Ahuja,et al.  Extraction and Analysis of Multiple Periodic Motions in Video Sequences , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  J. Alison Noble,et al.  Registration of Multiview Real-Time 3-D Echocardiographic Sequences , 2007, IEEE Transactions on Medical Imaging.

[25]  Elsa D. Angelini,et al.  VALIDATION OF OPTICAL-FLOW FOR QUANTIFICATION OF MYOCARDIAL DEFORMATIONS ON SIMULATED RT3D ULTRASOUND , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[26]  Paul Suetens,et al.  Three-Dimensional Cardiac Strain Estimation Using Spatio–Temporal Elastic Registration of Ultrasound Images: A Feasibility Study , 2008, IEEE Transactions on Medical Imaging.

[27]  Takeo Kanade,et al.  Nonrigid Structure from Motion in Trajectory Space , 2008, NIPS.

[28]  Kotagiri Ramamohanarao,et al.  Moving shape dynamics: A signal processing perspective , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Xiaoxu Wang,et al.  LV Motion and Strain Computation from tMRI Based on Meshless Deformable Models , 2008, MICCAI.

[30]  Dorin Comaniciu,et al.  Four-Chamber Heart Modeling and Automatic Segmentation for 3-D Cardiac CT Volumes Using Marginal Space Learning and Steerable Features , 2008, IEEE Transactions on Medical Imaging.

[31]  C. Lamberti,et al.  A Study of Functional Anatomy of Aortic-Mitral Valve Coupling Using 3D Matrix Transesophageal Echocardiography , 2009, Circulation. Cardiovascular imaging.

[32]  D. Mozaffarian,et al.  Heart disease and stroke statistics--2009 update: a report from the American Heart Association Statistics Committee and Stroke Statistics Subcommittee. , 2009, Circulation.

[33]  Elsa D. Angelini,et al.  Quantitative validation of optical flow based myocardial strain measures using sonomicrometry , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[34]  Wei Zhang,et al.  Robust guidewire tracking in fluoroscopy , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Alejandro F. Frangi,et al.  Large Diffeomorphic FFD Registration for Motion and Strain Quantification from 3D-US Sequences , 2009, FIMH.

[36]  D. Mozaffarian,et al.  Heart disease and stroke statistics--2009 update: a report from the American Heart Association Statistics Committee and Stroke Statistics Subcommittee. , 2009, Circulation.

[37]  S. Little Quantifying mitral valve regurgitation: new solutions from the 3rd dimension. , 2010, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[38]  Dorin Comaniciu,et al.  Volumetric Myocardial Mechanics from 3D+t Ultrasound Data with Multi-model Tracking , 2010, STACOM/CESC.

[39]  Alejandro F. Frangi,et al.  Automatic Cardiac MRI Segmentation Using a Biventricular Deformable Medial Model , 2010, MICCAI.

[40]  Dorin Comaniciu,et al.  Learning-based 3D myocardial motion flowestimation using high frame rate volumetric ultrasound data , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[41]  Nassir Navab,et al.  Patient-Specific Modeling and Quantification of the Aortic and Mitral Valves From 4-D Cardiac CT and TEE , 2010, IEEE Transactions on Medical Imaging.

[42]  Dorin Comaniciu,et al.  Automatic Delineation of Left and Right Ventricles in Cardiac MRI Sequences Using a Joint Ventricular Model , 2011, FIMH.

[43]  Yang Wang,et al.  Prediction Based Collaborative Trackers (PCT): A Robust and Accurate Approach Toward 3D Medical Object Tracking , 2011, IEEE Transactions on Medical Imaging.

[44]  Dorin Comaniciu,et al.  Learning-based hypothesis fusion for robust catheter tracking in 2D X-ray fluoroscopy , 2011, CVPR 2011.

[45]  Anuj Srivastava,et al.  Statistical Shape Analysis , 2014, Computer Vision, A Reference Guide.