Absolute joint moments: a novel image similarity measure

In this paper, we propose a novel approach for estimating image similarity. This measure is of importance in assessing image correspondence or image alignment and plays an important role in image registration. Currently, this problem is approached rather one-dimensionally since most registration methods consider the problem as either mono- or multi-modal. This perspective leads to the selection of some form of either the correlation coefficient (CC) or mutual information (MI) as image similarity measure (ISM). We propose a more generic framework for ISM construction, based on absolute joint moments, which can be considered as a generalization of CC. Within this framework, we propose a specific ISM that provides a different trade-off between MI and CC in terms of performance and computational cost for general registration problems. To illustrate this, we compared CC and MI with the proposed ISM and performed extensive experiments with regard to accuracy, robustness and speed. The evaluation demonstrated that the proposed absolute joint moments is a good combination of properties of CC and MI, with respect to speed and performance.

[1]  S. Sitharama Iyengar,et al.  Information theoretic similarity measures for content based image retrieval , 2001, J. Assoc. Inf. Sci. Technol..

[2]  S. Sitharama Iyengar,et al.  Informaton theoretic similarity measures for content based image retrieval , 2001 .

[3]  Dekang Lin,et al.  An Information-Theoretic Definition of Similarity , 1998, ICML.

[4]  Maya R. Gupta,et al.  Information-theoretic and Set-theoretic Similarity , 2006, 2006 IEEE International Symposium on Information Theory.

[5]  Thomas S. Huang,et al.  Image processing , 1971 .

[6]  Ron Kikinis,et al.  A Binary Entropy Measure to Assess Nonrigid Registration Algorithms , 2001, MICCAI.

[7]  J. Fitzpatrick,et al.  Medical image processing and analysis , 2000 .

[8]  David J. Hawkes,et al.  Information Theoretic Similarity Measures in Non-rigid Registration , 2003, IPMI.

[9]  Nathan D. Cahill,et al.  Overlap invariance of cumulative residual entropy measures for multimodal image alignment , 2009, Medical Imaging.

[10]  K. V. Arya,et al.  Image registration using robust M-estimators , 2007, Pattern Recognit. Lett..

[11]  Dinggang Shen,et al.  Multimodality image registration by maximization of quantitative-qualitative measure of mutual information , 2008, Pattern Recognit..

[12]  Amir Averbuch,et al.  A projection-based extension to phase correlation image alignment , 2007, Signal Process..

[13]  Dima Damen,et al.  Proceedings of the British Machine Vision Conference , 2014, BMVC 2014.

[14]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[15]  Max A. Viergever,et al.  Interpolation Artefacts in Mutual Information-Based Image Registration , 2000, Comput. Vis. Image Underst..

[16]  Milan Sonka,et al.  "Handbook of Medical Imaging, Volume 2. Medical Image Processing and Analysis " , 2000 .

[17]  Paul Suetens,et al.  Nonrigid Image Registration Using Conditional Mutual Information , 2010, IEEE Transactions on Medical Imaging.

[18]  Hany Farid,et al.  Medical image registration with partial data , 2006, Medical Image Anal..

[19]  Christopher E. Hann,et al.  Fast normalized cross correlation for motion tracking using basis functions , 2006, Comput. Methods Programs Biomed..

[20]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[21]  V.R.S Mani,et al.  Survey of Medical Image Registration , 2013 .

[22]  Guy Marchal,et al.  Automated multi-moda lity image registration based on information theory , 1995 .

[23]  William J. Christmas,et al.  Fast robust correlation , 2005, IEEE Transactions on Image Processing.

[24]  Yong Wang,et al.  Derivations of Normalized Mutual Information in Binary Classifications , 2007, 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery.

[25]  Yutaka Satoh,et al.  Using selective correlation coefficient for robust image registration , 2003, Pattern Recognit..

[26]  Geoffrey E. Hinton,et al.  Learning Generative Texture Models with extended Fields-of-Experts , 2009, BMVC.

[27]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[28]  Nicholas Ayache,et al.  The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration , 1998, MICCAI.

[29]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[30]  Max A. Viergever,et al.  General multimodal elastic registration based on mutual information , 1998, Medical Imaging.

[31]  Jian Guo Liu,et al.  Robust Phase Correlation based Motion Estimation and Its Applications , 2008, BMVC.

[32]  Isaac N. Bankman,et al.  Handbook of medical imaging , 2000 .

[33]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[34]  Sven Loncaric,et al.  A novel image similarity measure for image registration , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).