Image Registration and Segmentation

Information theoretic measures provide quantitative entropic divergences between two probability distributions or data sets. In this paper, we analyze the theoretical properties of the Jensen-Renyi divergence which is defined between any arbitrary number of probability distributions. Using the theory of majorization, we derive its maximum value, and also some performance upper bounds in terms of the Bayes risk and the asymptotic error of the nearest neighbor classifier. To gain further insight into the robustness and the application of the Jensen-Renyi divergence measure in imaging, we provide substantial numerical experiments to show the power of this entopic measure in image registration and segmentation.

[1]  S. M. Ali,et al.  A General Class of Coefficients of Divergence of One Distribution from Another , 1966 .

[2]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[3]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[4]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[5]  Yun He,et al.  Information theoretic measure for ISAR imagery focusing , 2000, SPIE Optics + Photonics.

[6]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[7]  A. Rényi.  On Measures of Entropy and Information , 1961 .

[8]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[9]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[10]  John R. Jensen,et al.  Introductory Digital Image Processing: A Remote Sensing Perspective , 1986 .

[11]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  J. H. B. Kemperman,et al.  Review: Albert W. Marshall and Ingram Olkin, Inequalities: Theory of majorization and its applications, and Y. L. Tong, Probability inequalities in multivariate distributions , 1981 .

[13]  José Martínez-Aroza,et al.  An Analysis of Edge Detection by Using the Jensen-Shannon Divergence , 2000, Journal of Mathematical Imaging and Vision.

[14]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Yun He,et al.  A generalized divergence measure for robust image registration , 2003, IEEE Trans. Signal Process..

[16]  M. Viergever,et al.  Medical image matching-a review with classification , 1993, IEEE Engineering in Medicine and Biology Magazine.

[17]  Guy Marchal,et al.  Multi-modality image registration by maximization of mutual information , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[18]  中澤 真,et al.  Devroye, L., Gyorfi, L. and Lugosi, G. : A Probabilistic Theory of Pattern Recognition, Springer (1996). , 1997 .

[19]  Alfred O. Hero,et al.  Applications of entropic spanning graphs , 2002, IEEE Signal Process. Mag..

[20]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[21]  Martin E. Hellman,et al.  Probability of error, equivocation, and the Chernoff bound , 1970, IEEE Trans. Inf. Theory.

[22]  Josiane Zerubia,et al.  Image retrieval and indexing: a hierarchical approach in computing the distance between textured images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[23]  J. Oliver,et al.  Sequence Compositional Complexity of DNA through an Entropic Segmentation Method , 1998 .