A robust method for aligning large-photometric-variation and noisy images

We propose a novel robust method to accurately align large-photometric-variation and noisy images emerged from high dynamic range (HDR) imaging. First, the keypoints are detected from optimal multi-binary images to eliminate the noise and photometric effects. The feature descriptor, which is translation-, rotation- and scale-invariant and robust to noise and photometric changes, is then developed, and feature matching is implemented efficiently by use of the structure information of the keypoints. Finally, mutual information (MI) is employed in the RANSAC method for homography estimation and performance assessment, which makes the results accurate and stable. Experiments carried out on synthesized images demonstrate that the proposed method is much more robust to both photometric changes and noise than the SIFT method, the state-of-the-art alignment method.

[1]  Vaclav Hlavaÿc Exposure time estimation for high dynamic range imaging with hand held camera , 2006 .

[2]  Shiqian Wu,et al.  Exposure-Robust Alignment of Differently Exposed Images , 2014, IEEE Signal Processing Letters.

[3]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[4]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[5]  Aleksandra Pizurica,et al.  Joint photometric and geometric image registration in the total least square sense , 2011, Pattern Recognit. Lett..

[6]  Shiqian Wu,et al.  Aligning multi-exposed images: What are the good feature and similarity measure? , 2015, 2015 IEEE 10th Conference on Industrial Electronics and Applications (ICIEA).

[7]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[8]  Murat Gevrekci,et al.  Illumination robust interest point detection , 2009, Comput. Vis. Image Underst..

[9]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[10]  Adrien Bartoli,et al.  Groupwise Geometric and Photometric Direct Image Registration , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Shree K. Nayar,et al.  Determining the Camera Response from Images: What Is Knowable? , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[13]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Anna Tomaszewska,et al.  Image Registration for Multi-exposure High Dynamic Range Image Acquisition , 2007 .

[15]  Marius Tico,et al.  Robust image registration for multi-frame mobile applications , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[16]  Greg Ward,et al.  Fast, Robust Image Registration for Compositing High Dynamic Range Photographs from Hand-Held Exposures , 2003, J. Graphics, GPU, & Game Tools.