Robust and accurate registration of images with unknown relative orientation and exposure

Nowadays, low-cost digital cameras embedded in mobile phones are becoming the main source of visual information. Nevertheless, its use is restricted to simple store and forward applications due to the limitations in the spatial resolution and dynamic range of those cameras. A registration algorithm is proposed to allow image mosaicing and therefore to increase camera applications. It is able to find the geometric relation between any image in the set, lacking any prior knowledge of the relative position and exposure of any image in the set, and working on low-overlapping pairs. It also deals with partial occlusions. The registration algorithm is based on the use of Zernike moments and RANSAC robust fitting to guarantee stability, and KLT tracker to provide accuracy. Besides, a radiometric compensation stage allows the development of a completely automatic and seamless mosaicing system.

[1]  Gregory Dudek,et al.  Rotation and zooming in image mosaicing , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[2]  Shree K. Nayar,et al.  Determining the Camera Response from Images: What Is Knowable? , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Robert Sobol,et al.  Improving the Retinex algorithm for rendering wide dynamic range photographs , 2002, IS&T/SPIE Electronic Imaging.

[4]  In-So Kweon,et al.  Probabilistic Model-Based Object Recognition Using Local Zernike Moments , 2002, MVA.

[5]  Rama Chellappa,et al.  Wide baseline image registration with application to 3-D face modeling , 2004, IEEE Transactions on Multimedia.

[6]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Patrick Clarysse,et al.  A review of cardiac image registration methods , 2002, IEEE Transactions on Medical Imaging.

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .