A unified framework for joint registration and segmentation

Accurate image registration is a necessary prerequisite for many diagnostic and therapy planning procedures where complementary information from different images has to be combined. The design of robust and reliable non-parametric registration schemes is currently a very active research area. Modern approaches combine the pure registration scheme with other image processing routines such that both ingredients may benefit from each other. One of the new approaches is the combination of segmentation and registration ("segistration"). Here, the segmentation part guides the registration to its desired configuration, whereas on the other hand the registration leads to an automatic segmentation. By joining these image processing methods it is possible to overcome some of the pitfalls of the individual methods. Here, we focus on the benefits for the registration task. In the current work, we present a novel unified framework for non-parametric registration combined with energy-based segmentation through active contours. In the literature, one may find various ways to combine these image processing routines. Here, we present the most promising approaches within the general framework. It is based on a single variational formulation of both the registration and the segmentation part. The performance tests are carried out for magnetic resonance (MR) images of the brain, and they demonstrate the potential of the proposed methods.

[1]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[2]  Tony F. Chan,et al.  A Multiphase Level Set Framework for Image Segmentation Using the Mumford and Shah Model , 2002, International Journal of Computer Vision.

[3]  Lars Hömke,et al.  A multigrid method for elastic image registration with additional structural constraints , 2006 .

[4]  Yang Wang Segmentation Guided Registration for Medical Images , 2005 .

[5]  Tony F. Chan,et al.  An Active Contour Model without Edges , 1999, Scale-Space.

[6]  Astrid Franz,et al.  Improved elastic medical image registration using mutual information , 2007, SPIE Medical Imaging.

[7]  N. Papenberg,et al.  A Fast and Flexible Image Registration Toolbox Design and Implementation of the General Approach , 2006 .

[8]  Baba C. Vemuri,et al.  Simultaneous Registration and Segmentation of Anatomical Structures from Brain MRI , 2005, MICCAI.

[9]  Yang Wang,et al.  A Unified Framework for Segmentation-Assisted Image Registration , 2006, ACCV.

[10]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[11]  C. Broit Optimal registration of deformed images , 1981 .

[12]  Balraj Naren,et al.  Medical Image Registration , 2022 .

[13]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[14]  Ting Song,et al.  Brain MRI Segmentation with Multiphase Minimal Partitioning: A Comparative Study , 2007, Int. J. Biomed. Imaging.

[15]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[16]  Gregory G. Slabaugh,et al.  Coupled PDEs for non-rigid registration and segmentation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[17]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[18]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[19]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1995, Proceedings of IEEE International Conference on Computer Vision.

[20]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[21]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .