Hyperspectral and Lidar Intensity Data Fusion: A Framework for the Rigorous Correction of Illumination, Anisotropic Effects, and Cross Calibration

The fusion of hyperspectral imaging (HSI) sensor and airborne lidar scanner (ALS) data provides promising potential for applications in environmental sciences. Standard fusion approaches use reflectance information from the HSI and distance measurements from the ALS to increase data dimensionality and geometric accuracy. However, the potential for data fusion based on the respective intensity information of the complementary active and passive sensor systems is high and not yet fully exploited. Here, an approach for the rigorous illumination correction of HSI data, based on the radiometric cross-calibrated return intensity information of ALS data, is presented. The cross calibration utilizes a ray tracing-based fusion of both sensor measurements by intersecting their particular beam shapes. The developed method is capable of compensating for the drawbacks of passive HSI systems, such as cast and cloud shadowing effects, illumination changes over time, across track illumination, and partly anisotropy effects. During processing, spatial and temporal differences in illumination patterns are detected and corrected over the entire HSI wavelength domain. The improvement in the classification accuracy of urban and vegetation surfaces demonstrates the benefit and potential of the proposed HSI illumination correction. The presented approach is the first step toward the rigorous in-flight fusion of passive and active system characteristics, enabling new capabilities for a variety of applications.