A principal component noise filter for high spectral resolution infrared measurements

[1] This paper describes the application of principal component analysis to reduce the random noise present in the hyperspectral infrared observations. Within a set of spectral observations the number of components needed to characterize the atmosphere is far less than the number of wavelengths observed, typically by a factor between 50 and 70. The higher-order components, which mainly serve to characterize noise, can be eliminated along with the noise that they characterize. The results obtained depend on the variability of the selected sets of observations and on specific instrument characteristics such as spectral resolution and noise statistics. For a set of 10,000 Fourier transform spectrometer (FTS) simulated spectra, whose standard deviation is about 10% of the mean, we were able to obtain noise reduction factors between 5 and 8. Results obtained from real FTS, with standard deviation of about 10% of the mean, indicated practical noise reduction between 5 and 6. To avoid loss of information in the presence of highly deviant observations, it is necessary to use a conservative number of principal components higher than the optimum to maximum noise reduction. However, even then, noise reduction factors of 4 are still achievable.

[1]  Jun Li,et al.  Thermodynamic product retrieval methodology and validation for NAST-I. , 2002, Applied optics.

[2]  G. Deco,et al.  An Information-Theoretic Approach to Neural Computing , 1997, Perspectives in Neural Computing.

[3]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[4]  H. Hotelling.  Analysis of a complex of statistical variables into principal components. , 1933 .

[5]  Thomas S. Pagano,et al.  Atomospheric Infrared Sounder (AIRS) on the Earth Observing System , 2001, SPIE Asia-Pacific Remote Sensing.

[6]  L. Larrabee Strow,et al.  Fast computation of monochromatic infrared atmospheric transmittances using compressed look-up tables , 1998 .

[7]  Frederick L. Williams,et al.  Cross-track Infrared Sounder (CrIS) development status , 2003, SPIE Optics + Photonics.

[8]  K. Schäfer,et al.  Analysis of aircraft exhausts with Fourier-transform infrared emission spectroscopy. , 1997, Applied optics.

[9]  William L. Smith,et al.  The Use of Interferometric Radiance Measurements for Sounding the Atmosphere. , 1979 .

[10]  P. Rosenkranz,et al.  Atmospheric Infrared Sounder , 1993 .

[11]  Hung-Lung Huang,et al.  Application of Principal Component Analysis to High-Resolution Infrared Measurement Compression and Retrieval , 2001 .

[12]  H. B. Howell,et al.  Radiometric calibration of IR Fourier transform spectrometers: solution to a problem with the High-Resolution Interferometer Sounder. , 1988, Applied optics.

[13]  I. Jolliffe.  Principal Component Analysis , 2002 .

[14]  William L. Smith,et al.  Vertical Resolution and Accuracy of Atmospheric Infrared Sounding Spectrometers. , 1992 .

[15]  Karl Pearson F.R.S..  LIII. On lines and planes of closest fit to systems of points in space , 1901 .