The automatic alignment and mosaic of video frames from the variable interference filter imaging spectrometer

The variable interference filter imaging spectrometer (VIFIS), is a modified video‐based remote sensing instrument. The creation of a hyperspectral cube for a flight line from the VIFIS instrument relies on the successful alignment and mosaic of sequential video frames. A number of techniques have been tested to assess which is the most reliable at finding accurately matched positions between sequential frames. Results show correlation techniques to be more successful than ordinal measures and invariant moments. Once a list of matching points had been created the transform between frames can be calculated and a mosaic generated. The application of an affine transform between every frame led to severe distortions in the imagery and rendered the final product useless. Experiments have shown that an affine transform was not required in each case and should only be applied when it provides an improvement over the mapping provided by a lower level transform.

[1]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[2]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[3]  Adrian N. Evans,et al.  Glacier surface motion computation from digital image sequences , 2000, IEEE Trans. Geosci. Remote. Sens..

[4]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[5]  Mark S. Nixon,et al.  Feature Extraction and Image Processing , 2002 .

[6]  Harpreet S. Sawhney,et al.  Automated Mosaics via Topology Inference , 2002, IEEE Computer Graphics and Applications.

[7]  A. Ardeshir Goshtasby,et al.  Template Matching in Rotated Images , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  R. Bindschadler,et al.  Application of image cross-correlation to the measurement of glacier velocity using satellite image data , 1992 .

[9]  Harpreet S. Sawhney,et al.  True multi-image alignment and its application to mosaicing and lens distortion correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Shree K. Nayar,et al.  Ordinal Measures for Image Correspondence , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Adrian N. Evans Cloud tracking using ordinal measures and relaxation labelling , 1999, IEEE 1999 International Geoscience and Remote Sensing Symposium. IGARSS'99 (Cat. No.99CH36293).

[12]  Siamak Khorram,et al.  A feature-based image registration algorithm using improved chain-code representation combined with invariant moments , 1999, IEEE Trans. Geosci. Remote. Sens..

[13]  Y. Gu,et al.  Geometric processing of hyperspectral image data acquired by VIFIS on board light aircraft , 2003 .

[14]  Q. X. Wu,et al.  Correlation and relaxation labelling: An experimental investigation on fast algorithms , 1997 .

[15]  D. Pan,et al.  Automatic registration of SeaWiFS and AVHRR imagery , 2001 .

[16]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.