Local frequency representations for robust multimodal image registration

Automatic registration of multimodal images involves algorithmically estimating the coordinate transformation required to align the data sets. Most existing methods in the literature are unable to cope with registration of image pairs with large nonoverlapping field of view (FOV). We propose a robust algorithm, based on matching dominant local frequency image representations, which can cope with image pairs with large nonoverlapping FOV The local frequency representation naturally allows for processing the data at different scales/resolutions, a very desirable property from a computational efficiency view point. Our algorithm involves minimizing-over all rigid/affine transformations-the integral of the squared error (ISE or L/sub 2/E) between a Gaussian model of the residual and its true density function. The residual here refers to the difference between the local frequency representations of the transformed (by an unknown transformation) source and target data. We present implementation results for image data sets, which are misaligned magnetic resonance (MR) brain scans obtained using different image acquisition protocols as well as misaligned MR-computed tomography scans. We experimently show that our L/sub 2/E-based scheme yields better accuracy over the normalized mutual information.

[1]  Hans Knutsson,et al.  Signal processing for computer vision , 1994 .

[2]  Manuel Servin,et al.  Adaptive quadrature filters and the recovery of phase from fringe pattern images , 1997 .

[3]  Colin Studholme,et al.  An overlap invariant entropy measure of 3D medical image alignment , 1999, Pattern Recognit..

[4]  Michael J. Black,et al.  A framework for the robust estimation of optical flow , 1993, 1993 (4th) International Conference on Computer Vision.

[5]  P. Anandan,et al.  Robust multi-sensor image alignment , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[6]  C. Pelizzari,et al.  Accurate Three‐Dimensional Registration of CT, PET, and/or MR Images of the Brain , 1989, Journal of computer assisted tomography.

[7]  B. Vemuri,et al.  A level-set based approach to image registration , 2000, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis. MMBIA-2000 (Cat. No.PR00737).

[8]  Max A. Viergever,et al.  Comparison of edge-based and ridge-based registration of CT and MR brain images , 1996, Medical Image Anal..

[9]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[10]  D. Louis Collins,et al.  Warping of a computerized 3-D atlas to match brain image volumes for quantitative neuroanatomical and functional analysis , 1991, Medical Imaging.

[11]  Sartaj Sahni,et al.  An efficient motion estimator with application to medical image registration , 1998, Medical Image Anal..

[12]  Shang-Hong Lai,et al.  Reliable and Efficient Computation of Optical Flow , 1998, International Journal of Computer Vision.

[13]  Jerry L. Prince,et al.  Brain image registration based on curve mapping , 1994, Proceedings of IEEE Workshop on Biomedical Image Analysis.

[14]  Wilson S. Geisler,et al.  Multichannel Texture Analysis Using Localized Spatial Filters , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Colin Studholme,et al.  Automated 3-D registration of MR and CT images of the head , 1996, Medical Image Anal..

[16]  A Collignon,et al.  Automated multimodality image registration using information theory , 1995 .

[17]  Jundong Liu,et al.  Robust Multimodal Image Registration Using Local Frequency Representations , 2001, IPMI.

[18]  Nicholas Ayache,et al.  Locally affine registration of free-form surfaces , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[20]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..