Current trends in medical image registration and fusion

Abstract Recently, medical image registration and fusion processes are considered as a valuable assistant for the medical experts. The role of these processes arises from their ability to help the experts in the diagnosis, following up the diseases’ evolution, and deciding the necessary therapies regarding the patient’s condition. Therefore, the aim of this paper is to focus on medical image registration as well as medical image fusion. In addition, the paper presents a description of the common diagnostic images along with the main characteristics of each of them. The paper also illustrates most well-known toolkits that have been developed to help the working with the registration and fusion processes. Finally, the paper presents the current challenges associated with working with medical image registration and fusion through illustrating the recent diseases/disorders that were addressed through such an analyzing process.

[1]  F. Arena,et al.  Multimodality data fusion aids early detection of breast cancer using conventional technology and advanced digital infrared imaging , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Nikos Paragios,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[3]  Robert Sheng Xu,et al.  Registration of Real-Time and Prior Imaging Data with Applications to MR Guided Cardiac Interventions , 2014, STACOM.

[4]  Georgios Sakas,et al.  Intraoperative Registration for Liver Tumor Ablation , 2011, Abdominal Imaging.

[5]  Tonghai Liu,et al.  Feasibility and potential benefits of defining the internal gross tumor volume of hepatocellular carcinoma using contrast-enhanced 4D CT images obtained by deformable registration , 2014, Radiation oncology.

[6]  Jerry L. Prince,et al.  Deformable Registration of High-Resolution and Cine MR Tongue Images , 2011, MICCAI.

[7]  Nikos Paragios,et al.  Joint Tumor Segmentation and Dense Deformable Registration of Brain MR Images , 2012, MICCAI.

[8]  Giovanna Rizzo,et al.  Multimodal non-rigid registration methods based on local variability measures in computed tomography and magnetic resonance brain images , 2014, IET Image Process..

[9]  Ayman El-Baz,et al.  State-of-the-Art Medical Image Registration Methodologies: A Survey , 2011 .

[10]  Robert Wolk,et al.  Obesity, Sleep Apnea, and Hypertension , 2003, Hypertension.

[11]  William M. Wells,et al.  2D-3D vascular registration between digital subtraction angiographic (DSA) and magnetic resonance angiographic (MRA) images , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[12]  Kawal S. Rhode,et al.  Registration and tracking to integrate X-ray and MR images in an XMR Facility , 2003, IEEE Transactions on Medical Imaging.

[13]  A. Vogel,et al.  Imaging techniques for Kaposi's sarcoma. , 2008, Journal of HIV therapy.

[14]  R. Wasserman,et al.  Biomedical imaging modalities: a tutorial. , 1995, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[15]  Thomas E. Yankeelov,et al.  Early DCE-MRI Changes after Longitudinal Registration May Predict Breast Cancer Response to Neoadjuvant Chemotherapy , 2012, WBIR.

[16]  Giovanni Maria Farinella,et al.  Advanced Topics in Computer Vision , 2013, Advances in Computer Vision and Pattern Recognition.

[17]  P. Guimarães,et al.  Fully-Automatic Multimodal Co-Registration of Retinal Fundus Images , 2014 .

[18]  F. Attneave.  Some informational aspects of visual perception. , 1954, Psychological review.

[19]  J. Hajnal,et al.  Detection of Subtle Brain Changes Using Subvoxel Registration and Subtraction of Serial MR Images , 1995, Journal of computer assisted tomography.

[20]  T. Fukutomi,et al.  Targeted sonography using an image fusion technique for evaluation of incidentally detected breast lesions on chest CT: a pilot study , 2016, Breast Cancer.

[21]  Mark A. Haidekker,et al.  Medical imaging technology , 2013 .

[22]  Murat Ekinci,et al.  Automatic panorama with auto-focusing based on image fusion for microscopic imaging system , 2014 .

[23]  Erlend Hodneland,et al.  Registration of FA and T1-Weighted MRI Data of Healthy Human Brain Based on Template Matching and Normalized Cross-Correlation , 2013, Journal of Digital Imaging.

[24]  Paul Suetens,et al.  A robust optimization strategy for intensity-based 2D/3D registration of knee implant models to single-plane fluoroscopy , 2007, SPIE Medical Imaging.

[25]  Petr Ourednicek,et al.  Novel registration-based framework for CT angiography in lower legs , 2013, Medical & Biological Engineering & Computing.

[26]  Ioannis A. Kakadiaris,et al.  Automated, Foot-Bone Registration Using Subdivision-Embedded Atlases for Spatial Mapping of Bone Mineral Density , 2013, Journal of Digital Imaging.

[27]  Padma Ganasala,et al.  Multimodality medical image fusion based on new features in NSST domain , 2014 .

[28]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .

[29]  D. Louis Collins,et al.  Rigid registration of 3D ultrasound and MRI: comparing two approaches on nine tumor cases , 2010 .

[30]  H. Levine.  Medical Imaging , 2010, Annals of Biomedical Engineering.

[31]  Roberto M. Lang,et al.  Automated Registration of 3D TEE Datasets of the Descending Aorta for Improved Examination and Quantification of Atheromas Burden , 2014, WBIR.

[32]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[33]  D. Kotton,et al.  A shift from cell cultures to creatures: in vivo imaging of small animals in experimental regenerative medicine. , 2011, Molecular therapy : the journal of the American Society of Gene Therapy.

[34]  Tony Lindeberg.  Edge Detection and Ridge Detection with Automatic Scale Selection , 2004, International Journal of Computer Vision.

[35]  Jocelyne Troccaz,et al.  MR prior based automatic segmentation of the prostate in TRUS images for MR/TRUS data fusion , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[36]  Stefan Klein,et al.  Registration of Free-Hand Ultrasound and MRI of Carotid Arteries through Combination of Point-Based and Intensity-Based Algorithms , 2012, WBIR.

[37]  Thomas Fechner,et al.  Pixel-level image fusion: the case of image sequences , 1998, Defense, Security, and Sensing.

[38]  D. Louis Collins,et al.  Comparing two approaches to rigid registration of three-dimensional ultrasound and magnetic resonance images for neurosurgery , 2011, International Journal of Computer Assisted Radiology and Surgery.

[39]  Mehran Ebrahimi,et al.  Deformable Image Registration and Intensity Correction of Cardiac Perfusion MRI , 2014, STACOM.

[40]  Dmitriy Meshkov,et al.  Deformable image registration for temporal subtraction of chest radiographs , 2013, International Journal of Computer Assisted Radiology and Surgery.

[41]  Yugang Min,et al.  4D-CT Lung registration using anatomy-based multi-level multi-resolution optical flow analysis and thin-plate splines , 2013, International Journal of Computer Assisted Radiology and Surgery.

[42]  Aqeel A. Al-Surmi,et al.  3D multimodal cardiac data reconstruction using angiography and computerized tomographic angiography registration , 2015, Journal of Cardiothoracic Surgery.

[43]  A. Dale,et al.  Assessment of pituitary adenoma volumetric change using longitudinal MR image registration , 2012, Neuroradiology.

[44]  S. Sitharama Iyengar,et al.  High Performance Adaptive Fidelity Algorithms for Multi-Modality Optic Nerve Head Image Fusion , 2011, J. Signal Process. Syst..

[45]  Dannie Durand,et al.  Scientific Data Mining , 2000 .

[46]  Jamshid Shanbehzadeh,et al.  An efficient approach for robust multimodal retinal image registration based on UR-SIFT features and PIIFD descriptors , 2013, EURASIP J. Image Video Process..

[47]  G K Svensson,et al.  Ultrasound image fusion for external beam radiotherapy for prostate cancer. , 1996, International journal of radiation oncology, biology, physics.

[48]  Maria A. Zuluaga,et al.  A Fast Lesion Registration to Assist Coronary Heart Disease Diagnosis in CTA Images , 2012, ICCVG.

[49]  Kavitha Srinivasan,et al.  Dual Channel Pulse Coupled Neural Network Algorithm for Fusion of Multimodality Brain Images with Quality Analysis , 2014 .

[50]  J. Bailes,et al.  Repetitive Traumatic Brain Injury and Development of Chronic Traumatic Encephalopathy: A Potential Role for Biomarkers in Diagnosis, Prognosis, and Treatment? , 2013, Front. Neur..

[51]  Thomas Martin Deserno,et al.  Biomedical Image Processing , 2013 .

[52]  Marius George Linguraru,et al.  MR Enterography Image Fusion in Small Bowel Analysis , 2013, CLIP.

[53]  Baris Turkbey,et al.  846 MRI/US FUSION PROSTATE BIOPSIES: CANCER DETECTION RATES , 2011 .

[54]  Richard B Reilly,et al.  Electrograms (ECG, EEG, EMG, EOG). , 2010, Technology and health care : official journal of the European Society for Engineering and Medicine.

[55]  Jinzhong Zhang,et al.  Study of the impact of CT/CT image fusion radiotherapy on V20 and radiation pneumonitis of non-small cell lung cancer , 2012 .

[56]  Huafeng Liu,et al.  Physiological Fusion of Functional and Structural Images for Cardiac Deformation Recovery , 2011, IEEE Transactions on Medical Imaging.

[57]  Sang Min Lee,et al.  Detailed analysis of the density change on chest CT of COPD using non-rigid registration of inspiration/expiration CT scans , 2015, European Radiology.

[58]  A. Umetsu,et al.  Impact of subject head motion on quantitative brain 15O PET and its correction by image-based registration algorithm , 2013, Annals of Nuclear Medicine.

[59]  Ali R. Khan,et al.  Multistructure Large Deformation Diffeomorphic Brain Registration , 2013, IEEE Transactions on Biomedical Engineering.

[60]  Hamid Behnam,et al.  Automatic Classification of Left Ventricular Regional Wall Motion Abnormalities in Echocardiography Images Using Nonrigid Image Registration , 2013, Journal of Digital Imaging.

[61]  Peter B. Greer,et al.  Structure-Guided Nonrigid Registration of CT-MR Pelvis Scans with Large Deformations in MR-Based Image Guided Radiation Therapy , 2013, CLIP.

[62]  Antoine Simon,et al.  Multimodal Registration and Data Fusion for Cardiac Resynchronization Therapy Optimization , 2014, IEEE Transactions on Medical Imaging.

[63]  Pan-Fu Kao,et al.  The impact of image fusion in resolving discrepant findings between FDG-PET and MRI/CT in patients with gynaecological cancers , 2003, European Journal of Nuclear Medicine and Molecular Imaging.

[64]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[65]  Jie Tian,et al.  A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration , 2010, IEEE Transactions on Biomedical Engineering.

[66]  K. P. Soman,et al.  Implementation and Comparative Study of Image Fusion Algorithms , 2010 .

[67]  Hans-Peter Kriegel,et al.  State-of-the-Art in Content-Based Image and Video Retrieval , 2001, Computational Imaging and Vision.

[68]  J. Fujimoto,et al.  Introduction to Optical Coherence Tomography , 2008 .

[69]  Christos Davatzikos,et al.  DRAMMS: Deformable Registration via Attribute Matching and Mutual-Saliency Weighting , 2009, IPMI.

[70]  Vinod Kumar,et al.  CT and MR Image Fusion Scheme in Nonsubsampled Contourlet Transform Domain , 2014, Journal of Digital Imaging.

[71]  Young Seok Kim,et al.  The application of PET-CT to post-mastectomy regional radiation therapy using a deformable image registration , 2013, Radiation oncology.

[72]  Christos Davatzikos,et al.  A novel 2D-3D registration algorithm for aligning fluoro images with 3D pre-op CT/MR images , 2006, SPIE Medical Imaging.

[73]  Fabrice Mériaudeau,et al.  Prostate multimodality image registration based on B-splines and quadrature local energy , 2012, International Journal of Computer Assisted Radiology and Surgery.

[74]  W. Bishop,et al.  Indirect Knowledge-Based Approach to Non-Rigid Multi-Modal Registration of Medical Images , 2007, 2007 Canadian Conference on Electrical and Computer Engineering.

[75]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[76]  Nassir Navab,et al.  Deformable registration of 3D vessel structures to a single projection image , 2008, SPIE Medical Imaging.

[77]  N. Beckmann.  In Vivo magnetic resonance techniques and drug discovery , 2006 .

[78]  Marcin Grzegorzek,et al.  A New Aortic Aneurysm CT Series Registration Algorithm , 2014 .

[79]  Daniel Rueckert,et al.  Simultaneous Reconstruction of 4-D Myocardial Motion from Both Tagged and Untagged MR Images Using Nonrigid Image Registration , 2010, MIAR.

[80]  David Sutton,et al.  The Whole Brain Atlas , 1999, BMJ.

[81]  David J. Hawkes,et al.  Postoperative Calculation of Acetabular Cup Position Using 2-D–3-D Registration , 2007, IEEE Transactions on Biomedical Engineering.

[82]  Nikos Chrisochoides,et al.  A Parallel Adaptive Physics-Based Non-rigid Registration Framework for Brain Tumor Resection , 2014, CompIMAGE.

[83]  Paul Suetens.  Fundamentals of Medical Imaging , 2002 .

[84]  Stan Z. Li,et al.  Markov Random Field Modeling in Image Analysis , 2001, Computer Science Workbench.

[85]  Aaron Fenster,et al.  Registration of In Vivo Prostate Magnetic Resonance Images to Digital Histopathology Images , 2010, Prostate Cancer Imaging.

[86]  Charles R. Meyer,et al.  Simultaneous usage of homologous points, lines, and planes for optimal, 3-D, linear registration of multimodality imaging data , 1995, IEEE Trans. Medical Imaging.

[87]  V. Mody,et al.  Introduction to metallic nanoparticles , 2010, Journal of pharmacy & bioallied sciences.

[88]  Richard L. Van Metter,et al.  Handbook of Medical Imaging , 2009 .

[89]  Brian B. Avants,et al.  Symmetric Diffeomorphic Image Registration: Evaluating Automated Labeling of Elderly and Neurodegenerative Cortex and Frontal Lobe , 2006, WBIR.

[90]  Dinggang Shen,et al.  Groupwise Registration via Graph Shrinkage on the Image Manifold , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[91]  Mary J. Lindstrom,et al.  Integrated PET/CT Fusion Imaging and Endoscopic Ultrasound in the Pre-operative Staging and Evaluation of Esophageal Cancer , 2011, Molecular Imaging and Biology.

[92]  Sébastien Ourselin,et al.  Nonlinear Elastic Spline Registration: Evaluation with Longitudinal Huntington's Disease Data , 2010, WBIR.

[93]  A. Ardeshir Goshtasby,et al.  Image Registration , 2012, Advances in Computer Vision and Pattern Recognition.