Towards CNN-Based Registration of Craniocaudal and Mediolateral Oblique 2-D X-ray Mammographic Images

We investigate methodologies for the automated registration of pairs of 2-D X-ray mammographic images, taken from the two standard mammographic angles. We present two exploratory techniques, based on Convolutional Neural Networks, to examine their potential for co-registration of findings on the two standard mammographic views. To test algorithm performance, our analysis uses a synthetic, surrogate data set for performing controlled experiments, as well as real 2-D X-ray mammogram imagery. The preliminary results are promising, and provide insights into how the proposed techniques may support multi-view X-ray mammography image registration currently and as technology evolves in the future.

[1]  N V Ruiter,et al.  AUTOMATIC IMAGE MATCHING FOR BREAST CANCER DIAGNOSTICS BY A 3D DEFORMATION MODEL OF THE MAMMA , 2002, Biomedizinische Technik. Biomedical engineering.

[2]  David A. Boas,et al.  Tetrahedral mesh generation from volumetric binary and grayscale images , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[3]  Marc Niethammer,et al.  Quicksilver: Fast predictive image registration – A deep learning approach , 2017, NeuroImage.

[4]  Subhransu Maji,et al.  Multi-view Convolutional Neural Networks for 3D Shape Recognition , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  王仁发.  第84届北美放射学会（Radiological Society of North America）概况与肌骨影 , 1999 .

[6]  Hervé Delingette,et al.  Robust Non-rigid Registration Through Agent-Based Action Learning , 2017, MICCAI.

[7]  Nico Karssemeijer,et al.  Matching mammographic regions in mediolateral oblique and cranio caudal views: a probabilistic approach , 2008, SPIE Medical Imaging.

[8]  Alex Krizhevsky,et al.  Learning Multiple Layers of Features from Tiny Images , 2009 .

[9]  Mitko Veta,et al.  Deformable image registration using convolutional neural networks , 2018, Medical Imaging.

[10]  Ayelet Akselrod-Ballin,et al.  Mammography Dual View Mass Correspondence , 2018, ArXiv.

[11]  N. V. Ruiter,et al.  Elastic registration of x-ray mammograms and three-dimensional magnetic resonance imaging data , 2010, Journal of Digital Imaging.

[12]  Sami Ur Rahman,et al.  INTRINSIC REGISTRATION TECHNIQUES FOR MEDICAL IMAGES: A STATE-OF-THE-ART REVIEW , 2016 .

[13]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[14]  Michael Brady,et al.  Correspondence between different view breast X-rays using a simulation of breast deformation , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[15]  João Manuel R S Tavares,et al.  Medical image registration: a review , 2014, Computer methods in biomechanics and biomedical engineering.

[16]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[17]  Rodney A. Kennedy,et al.  A Survey of Medical Image Registration on Multicore and the GPU , 2010, IEEE Signal Processing Magazine.

[18]  Daniel L Rubin,et al.  A curated mammography data set for use in computer-aided detection and diagnosis research , 2017, Scientific Data.

[19]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[21]  H. Iwase,et al.  [Breast cancer]. , 2006, Nihon rinsho. Japanese journal of clinical medicine.

[22]  Yong Fan,et al.  Non-rigid image registration using self-supervised fully convolutional networks without training data , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[23]  C. I. Watson,et al.  NIST Special Database 10 , 1993 .

[24]  Radhika Sivaramakrishna,et al.  Breast image registration techniques: a survey , 2006, Medical and Biological Engineering and Computing.

[25]  Michael Brady,et al.  Correspondence between Different View Breast X Rays Using Curved Epipolar Lines , 2001, Comput. Vis. Image Underst..

[26]  June-Goo Lee,et al.  Deep Learning in Medical Imaging: General Overview , 2017, Korean journal of radiology.

[27]  David J. Hawkes,et al.  A New Validation Method for X-ray Mammogram Registration Algorithms Using a Projection Model of Breast X-ray Compression , 2007, IEEE Transactions on Medical Imaging.

[28]  Won-Ki Jeong,et al.  ssEMnet: Serial-Section Electron Microscopy Image Registration Using a Spatial Transformer Network with Learned Features , 2017, DLMIA/ML-CDS@MICCAI.

[29]  Boudewijn P. F. Lelieveldt,et al.  Nonrigid Image Registration Using Multi-scale 3D Convolutional Neural Networks , 2017, MICCAI.

[30]  Tobias Gass,et al.  Total Variation Regularization of Displacements in Parametric Image Registration , 2014, ABDI@MICCAI.

[31]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[32]  A. Jemal,et al.  Cancer statistics, 2015 , 2015, CA: a cancer journal for clinicians.

[33]  Torsten Hopp,et al.  Automatic multimodal 2D/3D breast image registration using biomechanical FEM models and intensity-based optimization , 2013, Medical Image Anal..

[34]  Max A. Viergever,et al.  End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network , 2017, DLMIA/ML-CDS@MICCAI.