Automatic optical and IR image fusion for plant water stress analysis

Automatic registration of an optical image and an associated IR image is a key step toward to automation of canopy temperature measurement in the process of plant water stress analysis. In this context, the scene of the IR image is completely included in the optical image and the transform between the two images may involve translation and rotation by a small angle, though a small scale difference may also be present. This automatic registration of data from two quite different imaging regimes presents several challenges, and is not susceptible to several common image processing techniques. In this paper, an automatic image registration algorithm, based on the fundamental cross correlation method is designed, which can avoid human intervention in the alignment process and is suitable for the application to plant water stress analysis where significant numbers of images need to be processed. The effectiveness of the software design is demonstrated via our experiments and the registration error performance is compared to the cases where the similarity criterion is replaced by that of mutual information and correlation ratio respectively.

[1]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[3]  Nicholas Ayache,et al.  The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration , 1998, MICCAI.

[4]  B F Hutton,et al.  Non-rigid image registration using a median-filtered coarse-to-fine displacement field and a symmetric correlation ratio , 2001, Physics in medicine and biology.

[5]  H. Jones,et al.  Integrating hyperspectral imagery at different scales to estimate component surface temperatures , 2006 .

[6]  William K. Pratt,et al.  Correlation Techniques of Image Registration , 1974, IEEE Transactions on Aerospace and Electronic Systems.

[7]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[8]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1997, International Journal of Computer Vision.

[9]  P. E. Anuta,et al.  Digital Registration of Multispectral Video Imagery , 1969 .

[10]  Paul A. Viola,et al.  Alignment by Maximization of Mutual Information , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Hamlyn G. Jones,et al.  Use of thermography for quantitative studies of spatial and temporal variation of stomatal conductance over leaf surfaces , 1999 .

[13]  M. H. Prieto,et al.  Using Digital Images to Characterize Canopy Coverage and Light Interception in a Processing Tomato Crop , 2008 .

[14]  H. Jones,et al.  Combining thermal and visible imagery for estimating canopy temperature and identifying plant stress. , 2004, Journal of experimental botany.

[15]  Bao-Long Guo,et al.  Pseudo-log-polar Fourier transform for image registration , 2006, IEEE Signal Processing Letters.

[16]  H. Sinoquet,et al.  Experimental study of fruit temperature dynamics within apple tree crowns , 2009 .