Terrestrial imaging from visible light mosaics and a line-scan hyperspectral sensor

Hyperspectral imagery contains many different frequency bands for each pixel, enabling advanced detection algorithms. The so called pushbroom sensor technology is the most widespread realization of hyperspectral camera. Such cameras capture a single row of pixels, but each pixel can have hundreds of associated frequency bands . Assembling a full image from these pixel rows typically requires having a precise knowledge of the movement of the camera in space while it scans the desired area. In this research we present a procedure to build hyperspectral images from line sensor data without camera position information. The approach relies on an accompanying conventional camera and exploits the homographies between images of planar scenes for image mosaic construction. The hyperspectral camera is geometrically calibrated by using a special target and a variation of the Direct Linear Transform algorithm. This enables mapping the hyperspectral lines to each of the images in the mosaic, and a hyperspectral image can be built using the same homographies computed for the mosaic. Ideally, this research can enable small UAVs to perform enhanced detection and navigation previously reserved for high altitude aircraft.

[1]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[2]  J. J. Colls,et al.  Use of hyperspectral derivative ratios in the red-edge region to identify plant stress responses to gas leaks , 2004 .

[3]  Y. I. Abdel-Aziz Direct linear transformation from comparator coordinates in close-range photogrammetry , 1971 .

[4]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[5]  Niko Sünderhauf,et al.  COMPARING SEVERAL IMPLEMENTATIONS OF TWO RECENTLY PUBLISHED FEATURE DETECTORS , 2007 .

[6]  John P. Kerekes,et al.  Hyperspectral imaging phenomenology for the detection and tracking of pedestrians , 2012, 2012 IEEE International Geoscience and Remote Sensing Symposium.

[7]  Alexander F. H. Goetz,et al.  Three decades of hyperspectral remote sensing of the Earth: a personal view. , 2009 .

[8]  Shree K. Nayar,et al.  Generalized Mosaicing: Wide Field of View Multispectral Imaging , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Olivier D. Faugeras,et al.  Some Properties of the E Matrix in Two-View Motion Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Peter F. Sturm,et al.  Plane-Based Calibration for Linear Cameras , 2008, International Journal of Computer Vision.

[11]  Olivier Faugeras,et al.  Motion and Structure from Motion in a piecewise Planar Environment , 1988, Int. J. Pattern Recognit. Artif. Intell..

[12]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Fred A. Kruse,et al.  Comparison of airborne hyperspectral data and EO-1 Hyperion for mineral mapping , 2003, IEEE Trans. Geosci. Remote. Sens..

[14]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[15]  Heinrich Müller,et al.  Spatial free-form deformation with scattered data interpolation methods , 1992, Comput. Graph..

[16]  R. Webster,et al.  Kriging: a method of interpolation for geographical information systems , 1990, Int. J. Geogr. Inf. Sci..

[17]  Rajiv Gupta,et al.  Linear pushbroom cameras , 1997 .

[18]  Mohammad S. Alam,et al.  Spectral unmixing of hyperspectral data for oil spill detection , 2012, Optical Engineering + Applications.

[19]  Luis Merino,et al.  Unmanned Aerial Vehicle Localization Based on Monocular Vision and Online Mosaicking , 2009, J. Intell. Robotic Syst..

[20]  Peter M. Atkinson,et al.  Empirical correction of multiple flightline hyperspectral aerial image mosaics , 2011 .

[21]  Richard Szeliski,et al.  Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment , 2000, International Journal of Computer Vision.

[22]  Y. Kosugi,et al.  Prediction of sweetness and amino acid content in soybean crops from hyperspectral imagery , 2007 .

[23]  Xavier Armangué,et al.  A comparative review of camera calibrating methods with accuracy evaluation , 2002, Pattern Recognit..

[24]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[25]  C. Tucker Red and photographic infrared linear combinations for monitoring vegetation , 1979 .