A hybrid image registration technique for a digital camera image fusion application

Abstract In this paper, some image registration algorithms are investigated for the purpose of image fusion in a digital camera application. A hybrid scheme which uses both feature-based and intensity-based methods is proposed. In particular, an edge-based image registration approach is developed to guide the intensity-based registration which uses optical flow estimation. The idea of coarse-to-fine multi-scale iterative refinement is also utilized. The combination of these different methods tends to compensate for any deficiencies in the individual methods. Experiments show that our approach provides accurate registrations for the digital camera application. It is also demonstrated that the approach proves useful for registering some multi-spectral images.

[1]  R. Kwok,et al.  Automated Multisensor Registration: Requirements And Techniques , 1990, 10th Annual International Symposium on Geoscience and Remote Sensing.

[2]  A. Jepson,et al.  A fast subspace algorithm for recovering rigid motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[3]  P. Burt,et al.  Mechanisms for isolating component patterns in the sequential analysis of multiple motion , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[4]  Hans-Hellmut Nagel,et al.  On the Estimation of Optical Flow: Relations between Different Approaches and Some New Results , 1987, Artif. Intell..

[5]  B. S. Manjunath,et al.  A contour-based approach to multisensor image registration , 1995, IEEE Trans. Image Process..

[6]  Larry S. Davis,et al.  Shape Matching Using Relaxation Techniques , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Jake K. Aggarwal,et al.  On the computation of motion from sequences of images-A review , 1988, Proc. IEEE.

[9]  Allan D. Jepson,et al.  Simple method for computing 3D motion and depth , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[10]  Raimondo Schettini,et al.  Image registration by recognition of corresponding structures , 1990 .

[11]  Shmuel Peleg,et al.  Computing two motions from three frames , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[12]  Rick S. Blum,et al.  A categorization of multiscale-decomposition-based image fusion schemes with a performance study for a digital camera application , 1999, Proc. IEEE.

[13]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[14]  George C. Stockman,et al.  Matching Images to Models for Registration and Object Detection via Clustering , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Joachim Dengler,et al.  Local motion estimation with the dynamic pyramid , 1986 .

[16]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[17]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[18]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[19]  Chuan Yi Tang,et al.  A 2.|E|-Bit Distributed Algorithm for the Directed Euler Trail Problem , 1993, Inf. Process. Lett..

[20]  Wilfried Enkelmann,et al.  Investigations of multigrid algorithms for the estimation of optical flow fields in image sequences , 1988, Comput. Vis. Graph. Image Process..

[21]  D. Burr.  A dynamic model for image registration , 1981 .

[22]  D J Heeger,et al.  Model for the extraction of image flow. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[23]  William K. Pratt,et al.  Correlation Techniques of Image Registration , 1974, IEEE Transactions on Aerospace and Electronic Systems.

[24]  Ardeshir Goshtasby,et al.  A Region-Based Approach to Digital Image Registration with Subpixel Accuracy , 1986, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Jake K. Aggarwal,et al.  Contour registration by shape-specific points for shape matching , 1983, Comput. Vis. Graph. Image Process..

[26]  Harvey F. Silverman,et al.  A Class of Algorithms for Fast Digital Image Registration , 1972, IEEE Transactions on Computers.

[27]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[28]  Rama Chellappa,et al.  A computational vision approach to image registration , 1993, IEEE Trans. Image Process..

[29]  C. Nelson Dorny,et al.  A Vector Space Approach to Models and Optimization , 1983 .