Bayesian Technique for Image Classifying Registration

In this paper, we address a complex image registration issue arising while the dependencies between intensities of images to be registered are not spatially homogeneous. Such a situation is frequently encountered in medical imaging when a pathology present in one of the images modifies locally intensity dependencies observed on normal tissues. Usual image registration models, which are based on a single global intensity similarity criterion, fail to register such images, as they are blind to local deviations of intensity dependencies. Such a limitation is also encountered in contrast-enhanced images where there exist multiple pixel classes having different properties of contrast agent absorption. In this paper, we propose a new model in which the similarity criterion is adapted locally to images by classification of image intensity dependencies. Defined in a Bayesian framework, the similarity criterion is a mixture of probability distributions describing dependencies on two classes. The model also includes a class map which locates pixels of the two classes and weighs the two mixture components. The registration problem is formulated both as an energy minimization problem and as a maximum a posteriori estimation problem. It is solved using a gradient descent algorithm. In the problem formulation and resolution, the image deformation and the class map are estimated simultaneously, leading to an original combination of registration and classification that we call image classifying registration. Whenever sufficient information about class location is available in applications, the registration can also be performed on its own by fixing a given class map. Finally, we illustrate the interest of our model on two real applications from medical imaging: template-based segmentation of contrast-enhanced images and lesion detection in mammograms. We also conduct an evaluation of our model on simulated medical data and show its ability to take into account spatial variations of intensity dependencies while keeping a good registration accuracy.

[1]  Sabine Süsstrunk,et al.  Outlier Modeling in Image Matching , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Jeongtae Kim.  Intensity based image registration using robust similarity measure and constrained optimization: Applications for radiation therapy. , 2004 .

[3]  Ian W. Ricketts,et al.  The Mammographic Image Analysis Society digital mammogram database , 1994 .

[4]  David J. Hawkes,et al.  Incorporating connected region labelling into automated image registration using mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[5]  L. Held,et al.  Gaussian Markov Random Fields: Theory And Applications (Monographs on Statistics and Applied Probability) , 2005 .

[6]  Dinggang Shen,et al.  De-enhancing the Dynamic Contrast-Enhanced Breast MRI for Robust Registration , 2007, MICCAI.

[7]  Y. Amit,et al.  Towards a coherent statistical framework for dense deformable template estimation , 2007 .

[8]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[9]  D. Mumford.  The Bayesian Rationale for Energy Functionals 1 , 1994 .

[10]  M. Staring,et al.  Nonrigid registration with tissue-dependent filtering of the deformation field , 2007, Physics in medicine and biology.

[11]  Michael J. Black,et al.  On the unification of line processes, outlier rejection, and robust statistics with applications in early vision , 1996, International Journal of Computer Vision.

[12]  Francoise Preteux,et al.  Region-driven statistical nonrigid registration: application to model-based segmentation and tracking of the heart in perfusion MRI , 2005, SPIE Optics + Photonics.

[13]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[14]  Frédéric J. P. Richard,et al.  A SAEM algorithm for the estimation of template and deformation parameters in medical image sequences , 2009, Stat. Comput..

[15]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[16]  Frédéric J. P. Richard,et al.  A classifying registration technique for the estimation of enhancement curves of DCE-CT scan sequences , 2010, Medical Image Anal..

[17]  Nicu Sebe,et al.  Robust Computer Vision: Theory and Applications , 2003 .

[18]  Torsten Rohlfing,et al.  Intensity-Based Non-rigid Registration Using Adaptive Multilevel Free-Form Deformation with an Incompressibility Constraint , 2001, MICCAI.

[19]  R. Lenkinski,et al.  Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information. , 2011, Medical physics.

[20]  Jürgen Weese,et al.  Voxel-Based Similarity Measures for Medical Image Registration in Radiological Diagnosis and Image Guided Surgery , 1998 .

[21]  Jean-Michel Morel,et al.  From Gestalt Theory to Image Analysis: A Probabilistic Approach , 2007 .

[22]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[23]  Richard Szeliski,et al.  An integrated Bayesian approach to layer extraction from image sequences , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[24]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[25]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Jean Charles Gilbert,et al.  Numerical Optimization: Theoretical and Practical Aspects , 2003 .

[27]  Li Yuan-yuan.  A SURVEY OF MEDICAL IMAGE REGISTRATION , 2006 .

[28]  Wolfgang Straßer,et al.  A Probabilistic Framework for Robust and Accurate Matching of Point Clouds , 2004, DAGM-Symposium.

[29]  J. Alison Noble,et al.  MAP MRF joint segmentation and registration of medical images , 2003, Medical Image Anal..

[30]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[31]  Frédéric J. P. Richard.  A new approach for the registration of images with inconsistent differences , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[32]  Arthur B. Yeh,et al.  Fundamentals of Probability and Statistics for Engineers , 2005, Technometrics.

[33]  C. Broit.  Optimal registration of deformed images , 1981 .

[34]  Frédéric J. P. Richard,et al.  Combining Registration and Abnormality Detection in Mammography , 2006, WBIR.

[35]  Balraj Naren,et al.  Medical Image Registration , 2022 .

[36]  Karl J. Friston,et al.  Unified segmentation , 2005, NeuroImage.

[37]  M I Miller,et al.  Mathematical textbook of deformable neuroanatomies. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[38]  D. Louis Collins,et al.  Retrospective Evaluation of Inter-subject Brain Registration , 2001, MICCAI.

[39]  Philippe G. Ciarlet,et al.  The finite element method for elliptic problems , 2002, Classics in applied mathematics.

[40]  Kevin W. Bowyer,et al.  Registration and difference analysis of corresponding mammogram images , 1999, Medical Image Anal..

[41]  D. Louis Collins,et al.  Retrospective evaluation of intersubject brain registration , 2003, IEEE Transactions on Medical Imaging.

[42]  Azriel Rosenfeld,et al.  Robust regression methods for computer vision: A review , 1991, International Journal of Computer Vision.

[43]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  D. Ruppert.  Robust Statistics: The Approach Based on Influence Functions , 1987 .

[45]  Frédéric J. P. Richard,et al.  A mammogram registration technique dealing with outliers , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[46]  Daniel Rueckert,et al.  Volume and Shape Preservation of Enhancing Lesions when Applying Non-rigid Registration to a Time Series of Contrast Enhancing MR Breast Images , 2000, MICCAI.

[47]  W. Eric L. Grimson,et al.  A Bayesian model for joint segmentation and registration , 2006, NeuroImage.

[48]  Anant Madabhushi,et al.  Spatially weighted mutual information (SWMI) for registration of digitally reconstructed ex vivo whole mount histology and in vivo prostate MRI , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[49]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[50]  Peter J. Rousseeuw,et al.  Robust regression and outlier detection , 1987 .

[51]  Michael J. Black,et al.  Mixture models for optical flow computation , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Reto Meuli,et al.  Robust parameter estimation of intensity distributions for brain magnetic resonance images , 1998, IEEE Transactions on Medical Imaging.

[53]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[54]  Michael Brady,et al.  Simultaneous Segmentation and Registration of Contrast-Enhanced Breast MRI , 2005, IPMI.

[55]  G. Fix.  Review: Philippe G. Ciarlet, The finite element method for elliptic problems , 1979 .

[56]  Nicholas Ayache,et al.  The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration , 1998, MICCAI.

[57]  Nicholas Ayache,et al.  Unifying maximum likelihood approaches in medical image registration , 2000, Int. J. Imaging Syst. Technol..

[58]  Michael J. Black.  Robust incremental optical flow , 1992 .

[59]  Michael Brady,et al.  Analysis of dynamic MR breast images using a model of contrast enhancement , 1997, Medical Image Anal..

[60]  Don Geman,et al.  Modeling and Inverse Problems in Image Analysis , 2006 .

[61]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[62]  Fabrice Heitz,et al.  Robust voxel similarity metrics for the registration of dissimilar single and multimodal images , 1999, Pattern Recognit..

[63]  K. Mardia,et al.  A review of image-warping methods , 1998 .

[64]  Richard L. Scheaffer,et al.  Probability and statistics for engineers , 1986 .

[65]  R. Bajcsy,et al.  A computerized system for the elastic matching of deformed radiographic images to idealized atlas images. , 1983, Journal of computer assisted tomography.

[66]  Frédéric J. P. Richard,et al.  A Probabilistic Approach for the Simultaneous Mammogram Registration and Abnormality Detection , 2006, Digital Mammography / IWDM.

[67]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .

[68]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[69]  C. Metz.  ROC Methodology in Radiologic Imaging , 1986, Investigative radiology.

[70]  Nathan S. Netanyahu,et al.  Analytic outlier removal in line fitting , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[71]  Ruzena Bajcsy,et al.  Multiresolution elastic matching , 1989, Comput. Vis. Graph. Image Process..

[72]  Roger P. Woods.  Validation of registration accuracy , 2000 .

[73]  U. Grenander,et al.  Structural Image Restoration through Deformable Templates , 1991 .