Why Does Mutual-Information Work for Image Registration? A Deterministic Explanation

This paper proposes a deterministic explanation for mutual-information-based image registration (MI registration). The explanation is that MI registration works because it aligns certain image partitions. This notion of aligning partitions is new, and is shown to be related to Schur- and quasi-convexity. The partition-alignment theory of this paper goes beyond explaining mutual information. It suggests other objective functions for registering images. Some of these newer objective functions are not entropy-based. Simulations with noisy images show that the newer objective functions work well for registration, lending support to the theory. The theory proposed in this paper opens a number of directions for further research in image registration. These directions are also discussed.

[1]  Mert R. Sabuncu,et al.  Gradient based optimization of an EMST image registration function , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[2]  Ingram Olkin,et al.  Inequalities: Theory of Majorization and Its Application , 1979 .

[3]  D. J. H. Garling,et al.  The Cauchy-Schwarz Master Class: An Introduction to the Art of Mathematical Inequalities by J. Michael Steele , 2005, Am. Math. Mon..

[4]  L. Györfi,et al.  Nonparametric entropy estimation. An overview , 1997 .

[5]  Yunmei Chen,et al.  Cumulative residual entropy: a new measure of information , 2004, IEEE Transactions on Information Theory.

[6]  Guy Marchal,et al.  Automated multi-modality image registration based on information theory , 1995 .

[7]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[8]  Alfred O. Hero,et al.  Image registration with minimum spanning tree algorithm , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[9]  A. Hero,et al.  Entropic graphs for manifold learning , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[10]  Nicholas Ayache,et al.  Unifying maximum likelihood approaches in medical image registration , 2000, Int. J. Imaging Syst. Technol..

[11]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[12]  Paul F. Hemler,et al.  Grey value correlation techniques used for automatic matching of CT and MR brain and spine images , 1994, Other Conferences.

[13]  Yves Bizais,et al.  Registration of multimodality medical images using a region overlap criterion , 1992, CVGIP Graph. Model. Image Process..

[14]  Balraj Naren,et al.  Medical Image Registration , 2022 .

[15]  Suyash P. Awate,et al.  Point Set Registration Using Havrda–Charvat–Tsallis Entropy Measures , 2011, IEEE Transactions on Medical Imaging.

[16]  Max A. Viergever,et al.  f-information measures in medical image registration , 2004, IEEE Transactions on Medical Imaging.

[17]  Yun He,et al.  A generalized divergence measure for robust image registration , 2003, IEEE Trans. Signal Process..

[18]  Guy Marchal,et al.  Automated multi-moda lity image registration based on information theory , 1995 .

[19]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[20]  Alfred O. Hero,et al.  Image registration methods in high‐dimensional space , 2006, Int. J. Imaging Syst. Technol..

[21]  Anand Rangarajan,et al.  Probability Density Estimation Using Isocontours and Isosurfaces: Applications to Information-Theoretic Image Registration , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[23]  Paul Suetens,et al.  Nonrigid Image Registration Using Conditional Mutual Information , 2010, IEEE Transactions on Medical Imaging.

[24]  Jan Modersitzki,et al.  FAIR: Flexible Algorithms for Image Registration , 2009 .

[25]  A. Hero,et al.  Entropic Graphs for Registration , 2018, Multi-Sensor Image Fusion and Its Applications.

[26]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[27]  Baba C. Vemuri,et al.  Non-Rigid Multi-Modal Image Registration Using Cross-Cumulative Residual Entropy , 2007, International Journal of Computer Vision.