Priority-based error correction using turbo codes for compressed AIRS data

Errors due to wireless transmission can have an arbitrarily large impact on a compressed file. A single bit error appearing in the compressed file can propagate during a decompression procedure and destroy the entire granule. Such a loss is unacceptable since this data is critical for a range of applications, including weather prediction and emergency response planning. The impact of a bit error in the compressed granule is very sensitive to the error's location in the file. There is a natural hierarchy of compressed data in terms of impact on the final retrieval products. For the considered compression scheme, errors in some parts of the data yield no noticeable degradation in the final products. We formulate a priority scheme for the compressed data and present an error correction approach based on minimizing impact on the retrieval products. Forward error correction codes (e.g., turbo, LDPC) allow the tradeoff between error correction strength and file inflation (bandwidth expansion). We propose segmenting the compressed data based on its priority and applying different-strength FEC codes to different segments. In this paper we demonstrate that this approach can achieve negligible product degradation while maintaining an overall 3-to-1 compression ratio on the final file. We apply this to AIRS sounder data to demonstrate viability for the sounder on the next-generation GOES-R platform.

[1]  Mitchell D. Goldberg,et al.  Compression of AIRS data using Emperical Mode Decomposition , 2004, SPIE Optics + Photonics.

[2]  Thomas R. Fischer,et al.  Robust image transmission using JPEG2000 and turbo-codes , 2002 .

[3]  Hung-Lung Huang,et al.  Application of Principal Component Analysis to High-Resolution Infrared Measurement Compression and Retrieval , 2001 .

[4]  Richard H. Sherman,et al.  Chaotic communications in the presence of noise , 1993, Optics & Photonics.

[5]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[6]  Timothy J. Schmit,et al.  Current status of ultraspectral sounder data compression , 2005, SPIE Optics + Photonics.

[7]  David S. Taubman,et al.  Unequal protection of JPEG2000 code-streams in wireless channels , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[8]  E. Grayver,et al.  Multi-modulation programmable transceiver system with turbo coding , 2005, 2005 IEEE Aerospace Conference.

[9]  Lihang Zhou,et al.  AIRS near-real-time products and algorithms in support of operational numerical weather prediction , 2003, IEEE Trans. Geosci. Remote. Sens..

[10]  William L. Smith,et al.  AIRS/AMSU/HSB on the Aqua mission: design, science objectives, data products, and processing systems , 2003, IEEE Trans. Geosci. Remote. Sens..

[11]  Timothy J. Schmit,et al.  Fast precomputed VQ with optimal bit allocation for lossless compression of ultraspectral sounder data , 2005, Data Compression Conference.

[12]  Irina Gladkova,et al.  Adaptive clustering for hyperspectral sounder data compression , 2005, SPIE Optics + Photonics.