Multimodality Image Registration Using an Extensible Information Metric and High Dimensional Histogramming

We extend an information metric from intermodality (2-image) registration to multimodality (multiple-image) registration so that we can simultaneously register multiple images of different modalities. And we also provide the normalized version of the extensible information metric, which has better performance in high noise situations. Compared to mutual information which can even become negative in the multiple image case, our metric can be easily and naturally extended to multiple images. After using a new technique to efficiently compute high dimensional histograms, the extensible information metric can be efficiently computed even for multiple images. To showcase the new measure, we compare the results of direct multimodality registration using high-dimensional histogramming with repeated intermodality registration. We find that registering 3 images simultaneously with the new metric is more accurate than pair-wise registration on 2D images obtained from synthetic magnetic resonance (MR) proton density (PD), MR T2 and MR T1 3D volumes from Brain Web. We perform the unbiased registration of 5 multimodality images of anatomy, CT, MR PD, T1 and T2 from Visible Human Male Data with the normalized metric and high-dimensional histogramming. Our results demonstrate the efficacy of the metrics and high-dimensional histogramming in affine, multimodality image registration.