Fault-tolerant FFT data compression

Transform coefficients carry important data characteristics but can also be compressed significantly in many remote sensing applications. Failures in the several computing facilities that execute lossy compression algorithms and support the transmission of Fourier transform data can corrupt the values beyond recovery at the final destination. Various methods for including fault tolerance at the data processing level are exemplified by describing a protected system that computes the FFT, truncates small coefficients and compresses the remaining nonzero coefficients using lossless arithmetic coding. Algorithmic checks within the FFT and arithmetic encoding and decoding operations are augmented with additional features between and across several subsystems involved in compressing and transmitting the FFT data. End-to-end error detection is achieved in this manner.

[1]  Shu Lin,et al.  Error control coding : fundamentals and applications , 1983 .

[2]  Glen G. Langdon,et al.  An Introduction to Arithmetic Coding , 1984, IBM J. Res. Dev..

[3]  David Salomon,et al.  Data Compression: The Complete Reference , 2006 .

[4]  R. Chien,et al.  Error-Correcting Codes, Second Edition , 1973, IEEE Transactions on Communications.

[5]  Khalid Sayood,et al.  Joint source/channel coding for variable length codes , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[6]  G. Robert Redinbo,et al.  Fault tolerance, channel coding and arithmetic source coding combined , 1999, Digest of Papers. Twenty-Ninth Annual International Symposium on Fault-Tolerant Computing (Cat. No.99CB36352).

[7]  G. F. Elmasry.  Arithmetic coding algorithm with embedded channel coding , 1997 .

[8]  Ian H. Witten,et al.  Arithmetic coding for data compression , 1987, CACM.

[9]  Mark Nelson,et al.  The Data Compression Book , 2009 .

[10]  Niraj K. Jha,et al.  Algorithm-Based Fault Tolerance for FFT Networks , 1994, IEEE Trans. Computers.

[11]  David A. Patterson,et al.  Computer Organization & Design: The Hardware/Software Interface, Second Edition , 1997 .

[12]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[13]  Darrel Hankerson,et al.  Introduction to Information Theory and Data Compression , 2003 .

[14]  Hee Yong Youn,et al.  On concurrent error detection, location, and correction of FFT networks , 1993, FTCS-23 The Twenty-Third International Symposium on Fault-Tolerant Computing.