MITT: Medical Image Tracking Toolbox

Over the years, medical image tracking has gained considerable attention from both medical and research communities due to its widespread utility in a multitude of clinical applications, from functional assessment during diagnosis and therapy planning to structure tracking or image fusion during image-guided interventions. Despite the ever-increasing number of image tracking methods available, most still consist of independent implementations with specific target applications, lacking the versatility to deal with distinct end-goals without the need for methodological tailoring and/or exhaustive tuning of numerous parameters. With this in mind, we have developed the medical image tracking toolbox (MITT)—a software package designed to ease customization of image tracking solutions in the medical field. While its workflow principles make it suitable to work with 2-D or 3-D image sequences, its modules offer versatility to set up computationally efficient tracking solutions, even for users with limited programming skills. MITT is implemented in both C/C++ and MATLAB, including several variants of an object-based image tracking algorithm and allowing to track multiple types of objects (i.e., contours, multi-contours, surfaces, and multi-surfaces) with several customization features. In this paper, the toolbox is presented, its features discussed, and illustrative examples of its usage in the cardiology field provided, demonstrating its versatility, simplicity, and time efficiency.

[1]  C. Lamberti,et al.  A Study of Functional Anatomy of Aortic-Mitral Valve Coupling Using 3D Matrix Transesophageal Echocardiography , 2009, Circulation. Cardiovascular imaging.

[2]  Alejandro F. Frangi,et al.  Benchmarking framework for myocardial tracking and deformation algorithms: An open access database , 2013, Medical Image Anal..

[3]  Douglas L. Jones,et al.  Surface-Based CT–TEE Registration of the Aortic Root , 2013, IEEE Transactions on Biomedical Engineering.

[4]  Terry M. Peters,et al.  Image-guided interventions and computer-integrated therapy: Quo vadis? , 2016, Medical Image Anal..

[5]  Marc Modat,et al.  Lung registration using the NiftyReg package , 2010 .

[6]  Denis Friboulet,et al.  Fast Left Ventricle Tracking in 3D Echocardiographic Data Using Anatomical Affine Optical Flow , 2013, FIMH.

[7]  J. Gee,et al.  The Insight ToolKit image registration framework , 2014, Front. Neuroinform..

[8]  P. Sengupta,et al.  Assessment of myocardial mechanics using speckle tracking echocardiography: fundamentals and clinical applications. , 2010, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[9]  Terry M. Peters,et al.  US–Fluoroscopy Registration for Transcatheter Aortic Valve Implantation , 2012, IEEE Transactions on Biomedical Engineering.

[10]  Brecht Heyde,et al.  Fully automatic left ventricular myocardial strain estimation in 2D short-axis tagged magnetic resonance imaging , 2017, Physics in medicine and biology.

[11]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[12]  M. Raichle,et al.  Searching for a baseline: Functional imaging and the resting human brain , 2001, Nature Reviews Neuroscience.

[13]  Jeroen Hermans,et al.  Anatomical Image Registration Using Volume Conservation to Assess Cardiac Deformation From 3D Ultrasound Recordings , 2016, IEEE Transactions on Medical Imaging.

[14]  Sameer Singh,et al.  Advanced Algorithmic Approaches to Medical Image Segmentation , 2002, Advances in Computer Vision and Pattern Recognition.

[15]  Hui Wang,et al.  Cardiac Motion and Deformation Recovery From MRI: A Review , 2012, IEEE Transactions on Medical Imaging.

[16]  Oliver Burgert,et al.  A simple and accurate method for computer-aided transapical aortic valve replacement , 2016, Comput. Medical Imaging Graph..

[17]  J. Ehrhardt,et al.  An optical flow based method for improved reconstruction of 4D CT data sets acquired during free breathing. , 2007, Medical physics.

[18]  Hervé Delingette,et al.  Detailed Evaluation of Five 3D Speckle Tracking Algorithms Using Synthetic Echocardiographic Recordings , 2016, IEEE Transactions on Medical Imaging.

[19]  A. Arndt,et al.  Ultrasound-based testing of tendon mechanical properties: a critical evaluation. , 2015, Journal of applied physiology.

[20]  Benjamin Berkels,et al.  Survey of Non-Rigid Registration Tools in Medicine , 2017, Journal of Digital Imaging.

[21]  Victor Mor-Avi,et al.  Quantification of mitral apparatus dynamics in functional and ischemic mitral regurgitation using real-time 3-dimensional echocardiography. , 2008, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[22]  Bostjan Likar,et al.  A review of 3D/2D registration methods for image-guided interventions , 2012, Medical Image Anal..

[23]  Chuan Zhou,et al.  Deep Learning in Medical Image Analysis. , 2017, Advances in experimental medicine and biology.

[24]  Kunio Doi,et al.  Computer-aided diagnosis in medical imaging: Historical review, current status and future potential , 2007, Comput. Medical Imaging Graph..

[25]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.

[26]  William E. Lorensen,et al.  The visualization toolkit (2nd ed.): an object-oriented approach to 3D graphics , 1998 .

[27]  YingLiang Ma,et al.  Fast Catheter Segmentation From Echocardiographic Sequences Based on Segmentation From Corresponding X-Ray Fluoroscopy for Cardiac Catheterization Interventions , 2015, IEEE Transactions on Medical Imaging.

[28]  Jocelyne Troccaz,et al.  Prostate biopsy tracking with deformation estimation , 2011, Medical Image Anal..

[29]  E. Samset,et al.  Left atrial volumetric assessment using a novel automated framework for 3D echocardiography: a multi-centre analysis , 2017, European heart journal cardiovascular Imaging.

[30]  Jan D’hooge,et al.  Fast left ventricle tracking using localized anatomical affine optical flow , 2017, International journal for numerical methods in biomedical engineering.

[31]  Victor Mor-Avi,et al.  Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. , 2015, European heart journal cardiovascular Imaging.

[32]  K. Cleary,et al.  Image-guided interventions: technology review and clinical applications. , 2010, Annual review of biomedical engineering.

[33]  Maxime Sermesant,et al.  Spatio-Temporal Tensor Decomposition of a Polyaffine Motion Model for a Better Analysis of Pathological Left Ventricular Dynamics , 2015, IEEE Transactions on Medical Imaging.

[34]  Robert C Gorman,et al.  Dynamic 3-dimensional echocardiographic assessment of mitral annular geometry in patients with functional mitral regurgitation. , 2013, The Annals of thoracic surgery.

[35]  Deep Learning for Medical Image Analysis, 1st Edition , 2017 .

[36]  Nikos Paragios,et al.  Deformable Medical Image Registration: A Survey , 2013, IEEE Transactions on Medical Imaging.

[37]  G. Pedrizzetti,et al.  Definitions for a common standard for 2D speckle tracking echocardiography: consensus document of the EACVI/ASE/Industry Task Force to standardize deformation imaging. , 2015, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[38]  Johan G Bosch,et al.  Development and validation of ultrasound speckle tracking to quantify tendon displacement. , 2010, Journal of biomechanics.

[39]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[40]  Steve B. Jiang,et al.  Lung tumor tracking in fluoroscopic video based on optical flow. , 2008, Medical physics.

[41]  Nassir Navab,et al.  Patient-Specific Modeling and Quantification of the Aortic and Mitral Valves From 4-D Cardiac CT and TEE , 2010, IEEE Transactions on Medical Imaging.

[42]  H. Torp,et al.  3-D speckle tracking for assessment of regional left ventricular function. , 2009, Ultrasound in medicine & biology.

[43]  Olivier Bernard,et al.  3D harmonic phase tracking with anatomical regularization , 2015, Medical Image Anal..

[44]  Denis Friboulet,et al.  Whole myocardium tracking in 2D-echocardiography in multiple orientations using a motion constrained level-set , 2014, Medical Image Anal..

[45]  Denis Friboulet,et al.  Fast automatic myocardial segmentation in 4D cine CMR datasets , 2014, Medical Image Anal..

[46]  O Somphone,et al.  The 2014 liver ultrasound tracking benchmark , 2015, Physics in medicine and biology.

[47]  Antje Baer,et al.  Handbook Of Medical Image Processing And Analysis , 2016 .

[48]  Lixu Gu,et al.  Intra-Operative 2-D Ultrasound and Dynamic 3-D Aortic Model Registration for Magnetic Navigation of Transcatheter Aortic Valve Implantation , 2013, IEEE Transactions on Medical Imaging.

[49]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[50]  Charles J Bruce,et al.  Echocardiographic and Fluoroscopic Fusion Imaging for Procedural Guidance: An Overview and Early Clinical Experience. , 2016, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[51]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.