Coercive region-level registration for multi-modal images

We propose a coercive approach to simultaneously register and segment multi-modal images which share similar spatial structure. Registration is done at the region level to facilitate data fusion while avoiding the need for interpolation. The algorithm performs alternating minimization of an objective function informed by statistical models for pixel values in different modalities. Hypothesis tests are developed to determine whether to refine segmentations by splitting regions. We demonstrate that our approach has significantly better performance than the state-of-the-art registration and segmentation methods on microscopy images.

[1]  M. Acciarri,et al.  EBIC, EBSD and TEM study of grain boundaries in multicrystalline silicon cast from metallurgical feedstock , 2008, 2008 33rd IEEE Photovoltaic Specialists Conference.

[2]  Gemma Piella,et al.  A general framework for multiresolution image fusion: from pixels to regions , 2003, Inf. Fusion.

[3]  Tai Sing Lee,et al.  Region competition: unifying snakes, region growing, energy/Bayes/MDL for multi-band image segmentation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[4]  K. Tanaka,et al.  EBSD-AFM hybrid analysis of fatigue slip system and crack initiation in polycrystalline metal under cyclic torsional loading , 2005, IEEE International Symposium on Micro-NanoMechatronics and Human Science, 2005.

[5]  D. N. Duhl,et al.  Effect of Minor Elements on the Deformation Behavior of Nickel-Base Superalloys , 1988 .

[6]  David C. Joy,et al.  Scanning Electron Microscopy and X-Ray Microanalysis , 2017 .

[7]  E. S. Pearson,et al.  On the Problem of the Most Efficient Tests of Statistical Hypotheses , 1933 .

[8]  Richard Szeliski,et al.  Spline-Based Image Registration , 1997, International Journal of Computer Vision.

[9]  Helmut Schaeben,et al.  Grain detection from 2d and 3d EBSD data--specification of the MTEX algorithm. , 2011, Ultramicroscopy.

[10]  S. R. Jammalamadaka,et al.  Directional Statistics, I , 2011 .

[11]  A. Morawiec,et al.  Rodrigues parameterization for orientation and misorientation distributions , 1996 .

[12]  Alfred O. Hero,et al.  Parameter Estimation in Spherical Symmetry Groups , 2015, IEEE Signal Processing Letters.

[13]  Daniel Rueckert,et al.  Nonrigid registration using free-form deformations: application to breast MR images , 1999, IEEE Transactions on Medical Imaging.

[14]  E. S. Pearson,et al.  Hypotheses On the Problem of the Most Efficient Tests of Statistical , 2006 .

[15]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[16]  Cedric Nishan Canagarajah,et al.  Segmentation-Driven Image Fusion Based on Alpha-Stable Modeling of Wavelet Coefficients , 2009, IEEE Transactions on Multimedia.

[17]  Ilya Pollak,et al.  An automated segmentation for nickel-based superalloy , 2008, 2008 15th IEEE International Conference on Image Processing.

[18]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[19]  I. Dhillon,et al.  Modeling Data using Directional Distributions , 2003 .

[20]  S. Altmann Rotations, Quaternions, and Double Groups , 1986 .

[21]  Mukul Kumar,et al.  Electron Backscatter Diffraction in Materials Science , 2000 .

[22]  M. Pagano,et al.  Student's t test. , 1993, Nutrition.

[23]  Frank Nielsen,et al.  Statistical region merging , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.