Learning-Based Detection and Tracking in Medical Imaging: A Probabilistic Approach

Medical image processing tools are playing an increasingly important role in assisting the clinicians in diagnosis, therapy planning and image-guided interventions. Accurate, robust and fast tracking of deformable anatomical objects, such as the heart, is a crucial task in medical image analysis. One of the main challenges is to maintain an anatomically consistent representation of target appearance that is robust enough to cope with inherent changes due to target movement, imaging device movement, varying imaging conditions, and is consistent with the domain expert clinical knowledge. To address these challenges, this chapter presents a probabilistic framework that relies on anatomically indexed component-based object models which integrate several sources of information to determine the temporal trajectory of the deformable target. Large annotated imaging databases are exploited to encode the domain knowledge in shape models and motion models and to learn discriminative image classifiers for the target appearance. The framework robustly fuses the prior information with traditional tracking approaches based on template matching and registration. We demonstrate various medical image analysis applications with focus on cardiology such as 2D auto left heart, catheter detection and tracking, 3D cardiac chambers surface tracking, and 4D complex cardiac structure tracking, in multiple modalities including Ultrasound (US), cardiac Computed Tomography (CT), Magnetic Resonance Imaging (MRI), and X-ray fluoroscopy.

[1]  Shehzad Khalid,et al.  Motion Trajectory Learning in the DFT-Coefficient Feature Space , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[2]  S. Little Quantifying mitral valve regurgitation: new solutions from the 3rd dimension. , 2010, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[3]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Elsa D. Angelini,et al.  Quantitative validation of optical flow based myocardial strain measures using sonomicrometry , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[5]  Narendra Ahuja,et al.  Extraction and Analysis of Multiple Periodic Motions in Video Sequences , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Timothy F. Cootes,et al.  Statistical models of appearance for medical image analysis and computer vision , 2001, SPIE Medical Imaging.

[7]  Dorin Comaniciu,et al.  Automatic Delineation of Left and Right Ventricles in Cardiac MRI Sequences Using a Joint Ventricular Model , 2011, FIMH.

[8]  C. Lamberti,et al.  A Study of Functional Anatomy of Aortic-Mitral Valve Coupling Using 3D Matrix Transesophageal Echocardiography , 2009, Circulation. Cardiovascular imaging.

[9]  Dorin Comaniciu,et al.  Four-Chamber Heart Modeling and Automatic Segmentation for 3-D Cardiac CT Volumes Using Marginal Space Learning and Steerable Features , 2008, IEEE Transactions on Medical Imaging.

[10]  Takeo Kanade,et al.  Nonrigid Structure from Motion in Trajectory Space , 2008, NIPS.

[11]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Dorin Comaniciu,et al.  Database-guided segmentation of anatomical structures with complex appearance , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Chandra Kambhamettu,et al.  A Coarse-to-Fine Deformable Contour Optimization Framework , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  James D. Thomas,et al.  Segmentation and tracking in echocardiographic sequences: active contours guided by optical flow estimates , 1998, IEEE Transactions on Medical Imaging.

[15]  J. Alison Noble,et al.  Registration of Multiview Real-Time 3-D Echocardiographic Sequences , 2007, IEEE Transactions on Medical Imaging.

[16]  Alejandro F. Frangi,et al.  Large Diffeomorphic FFD Registration for Motion and Strain Quantification from 3D-US Sequences , 2009, FIMH.

[17]  Dorin Comaniciu,et al.  Robust real-time myocardial border tracking for echocardiography: an information fusion approach , 2004, IEEE Transactions on Medical Imaging.

[18]  K. Mardia,et al.  Statistical Shape Analysis , 1998 .

[19]  Xiaoxu Wang,et al.  LV Motion and Strain Computation from tMRI Based on Meshless Deformable Models , 2008, MICCAI.

[20]  Ramakant Nevatia,et al.  3D tracking of human locomotion: a tracking as recognition approach , 2002, Object recognition supported by user interaction for service robots.

[21]  Paul Suetens,et al.  Three-Dimensional Cardiac Strain Estimation Using Spatio–Temporal Elastic Registration of Ultrasound Images: A Feasibility Study , 2008, IEEE Transactions on Medical Imaging.

[22]  Wei Zhang,et al.  Robust guidewire tracking in fluoroscopy , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[24]  Timothy F. Cootes,et al.  Face Recognition Using Active Appearance Models , 1998, ECCV.

[25]  Olivier Ecabert,et al.  Optimizing boundary detection via Simulated Search with applications to multi-modal heart segmentation , 2010, Medical Image Anal..

[26]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[27]  Sébastien Ourselin,et al.  A Registration-Based Propagation Framework for Automatic Whole Heart Segmentation of Cardiac MRI , 2010, IEEE Transactions on Medical Imaging.

[28]  Lihi Zelnik-Manor,et al.  Temporal Factorization vs. Spatial Factorization , 2004, ECCV.

[29]  Dorin Comaniciu,et al.  Catheter Tracking via Online Learning for Dynamic Motion Compensation in Transcatheter Aortic Valve Implantation , 2012, MICCAI.

[30]  Yang Wang,et al.  Prediction Based Collaborative Trackers (PCT): A Robust and Accurate Approach Toward 3D Medical Object Tracking , 2011, IEEE Transactions on Medical Imaging.

[31]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Alejandro F. Frangi,et al.  Automatic Cardiac MRI Segmentation Using a Biventricular Deformable Medial Model , 2010, MICCAI.

[33]  Zhuowen Tu,et al.  Probabilistic boosting-tree: learning discriminative models for classification, recognition, and clustering , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[34]  Dorin Comaniciu,et al.  Nonparametric information fusion for motion estimation , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[35]  Dorin Comaniciu,et al.  Real-Time Multi-model Tracking of Myocardium in Echocardiography Using Robust Information Fusion , 2004, MICCAI.

[36]  D. Mozaffarian,et al.  Heart disease and stroke statistics--2009 update: a report from the American Heart Association Statistics Committee and Stroke Statistics Subcommittee. , 2009, Circulation.

[37]  Dorin Comaniciu,et al.  Learning-based 3D myocardial motion flowestimation using high frame rate volumetric ultrasound data , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[38]  J. Alison Noble,et al.  A shape-space-based approach to tracking myocardial borders and quantifying regional left-ventricular function applied in echocardiography , 2002, IEEE Transactions on Medical Imaging.

[39]  David J. Fleet,et al.  Stochastic Tracking of 3D Human Figures Using 2D Image Motion , 2000, ECCV.

[40]  Dorin Comaniciu,et al.  Volumetric Myocardial Mechanics from 3D+t Ultrasound Data with Multi-model Tracking , 2010, STACOM/CESC.

[41]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[42]  Nassir Navab,et al.  Patient-Specific Modeling and Quantification of the Aortic and Mitral Valves From 4-D Cardiac CT and TEE , 2010, IEEE Transactions on Medical Imaging.

[43]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[44]  Gunnar Seemann,et al.  Functional Imaging and Modeling of the Heart , 2003, Lecture Notes in Computer Science.

[45]  Michael J. Black,et al.  EigenTracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation , 1996, International Journal of Computer Vision.

[46]  Dorin Comaniciu,et al.  Learning-based hypothesis fusion for robust catheter tracking in 2D X-ray fluoroscopy , 2011, CVPR 2011.

[47]  Kotagiri Ramamohanarao,et al.  Moving shape dynamics: A signal processing perspective , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Hai Tao,et al.  Dynamic layer representation with applications to tracking , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).