Data compression for MingantU SpEctral Radioheliograpy

In recent years, the high resolution, high precision and high sensitivity telescopes have been widely developed for astronomical observation in the world, such as SKA, Arecibo, ALMA and MingantU SpEctral Radioheliograpy (Muser). Along with these newly developed modern telescopes, a “big data” challenge was raised for data storage and processing. For example, Muser produces about 4.3TB raw data for daily solar radio observation, which presents a great challenge for archiving, analysing, transmitting and storage of data. In this paper, for the first time, we investigate data compression of Muser. We seek a lossless compressor, meanwhile, with good compression efficiency and affordable computational complexity.

[1]  Yihua Yan,et al.  Image Simulation for Mingantu Ultrawide Spectral Radioheliograph in the Decimetre Wave Range , 2015, Publications of the Astronomical Society of Australia.

[2]  Enrique García-Berro,et al.  Efficient data storage of astronomical data using HDF5 and PEC compression , 2011, Remote Sensing.

[3]  Abraham Lempel,et al.  A universal algorithm for sequential data compression , 1977, IEEE Trans. Inf. Theory.

[4]  Laura B. Newburgh,et al.  A compression scheme for radio data in high performance computing , 2015, Astron. Comput..

[5]  David Taubman,et al.  Astronomical imagery: Considerations for a contemporary approach with JPEG2000 , 2014 .

[6]  Long Xu,et al.  Perceptual image quality enhancement for solar radio image , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[7]  Vyacheslav V. Kitaeff,et al.  The impact of JPEG2000 lossy compression on the scientific quality of radio astronomy imagery , 2014 .

[8]  Christopher J. Fluke,et al.  Data compression in the petascale astronomy era: A GERLUMPH case study , 2015, Astron. Comput..

[9]  E. Lenc,et al.  GLEAM: The GaLactic and Extragalactic All-Sky MWA Survey , 2015, Publications of the Astronomical Society of Australia.

[10]  Simon Winberg,et al.  Lossless Compression of SKA Data Sets , 2013 .

[11]  Long Xu,et al.  Perceptual Quality Improvement for Synthesis Imaging of Chinese Spectral Radioheliograph , 2015, PCM.

[12]  J. Högbom,et al.  APERTURE SYNTHESIS WITH A NON-REGULAR DISTRIBUTION OF INTERFEROMETER BASELINES. Commentary , 1974 .

[13]  Yihua Yan,et al.  Radio imaging-spectroscopy observations of the Sun in decimetric and centimetric wavelengths , 2012, Proceedings of the International Astronomical Union.