FAPEC, a versatile and efficient data compressor for space missions

ABSTRACT Fully Adaptive Prediction Error Coder (FAPEC) is a data compressor which offers good compression ratios even when data is severely affected by noise and outliers. This, combined with its high computing performance, makes it suitable for space applications. It is based on a variety of pre-processing stages followed by an outlier-resilient adaptive entropy coder. Sample sizes of 8–24 bits are supported. Pre-processing stages range from simple delta algorithms (with interleaving, lossy, and filtering options) to more complex discrete wavelet transform and Hierarchical Pixel Averaging image algorithms (with or without losses, for single or multiple bands). A quick prediction-based lossless multi-band algorithm is also available, as well as lightweight dictionary-like pattern recognition. Thus, one can have functionalities equivalent to those of Consultative Committee for Space Data Systems (CCSDS) 121.0, 122.x, and 123.x in a single system, as well as some features not supported yet by any recommendation. Here, we describe the main features of FAPEC and the results obtained on a variety of data, comparing compression ratios and speeds against CCSDS standards.

[1]  Jordi Portell,et al.  FAPEC-based lossless and lossy hyperspectral data compression , 2015, SPIE Remote Sensing.

[2]  Wallace M. Porter,et al.  A System Overview Of The Airborne Visible/Infrared Imaging Spectrometer (Aviris) , 1987, Optics & Photonics.

[3]  Abraham Lempel,et al.  A universal algorithm for sequential data compression , 1977, IEEE Trans. Inf. Theory.

[4]  Jordi Portell,et al.  Quick outlier-resilient entropy coder for space missions , 2010 .

[5]  Martin Pilgram,et al.  Consultative Committee For Space Data Systems , 2009 .

[6]  Enrico Magli,et al.  Optimized onboard lossless and near-lossless compression of hyperspectral data using CALIC , 2004, IEEE Geoscience and Remote Sensing Letters.

[7]  Jordi Portell,et al.  Outlier-Resilient Entropy Coding , 2012 .

[8]  Paul M. Brunet,et al.  The Gaia mission , 2013, 1303.0303.

[9]  Alberto González Villafranca Integration of FAPEC as data compressor stage in a SpaceFibre link , 2016 .

[10]  Shan Mignot,et al.  Hardware implementation of the FAPEC lossless data compressor for space , 2010, 2010 NASA/ESA Conference on Adaptive Hardware and Systems.

[11]  Guillermo Sapiro,et al.  LOCO-I: a low complexity, context-based, lossless image compression algorithm , 1996, Proceedings of Data Compression Conference - DCC '96.

[12]  Jordi Portell,et al.  Discrete wavelet transform fully adaptive prediction error coder: image data compression based on CCSDS 122.0 and fully adaptive prediction error coder , 2013 .

[13]  Shaun A. Thomas,et al.  Cosmology and Fundamental Physics with the Euclid Satellite , 2012, Living Reviews in Relativity.

[14]  Jordi Portell,et al.  Prediction Error Coder: a fast lossless compression method for satellite noisy data , 2013 .

[15]  Valero Laparra,et al.  Regression Wavelet Analysis for Lossless Coding of Remote-Sensing Data , 2016, IEEE Transactions on Geoscience and Remote Sensing.