Hyperspectral Compressive Sensing With a System-On-Chip FPGA

Advances in hyperspectral sensors have led to a significantly increased capability for high-quality data. This trend calls for the development of new techniques to enhance the way that such unprecedented volumes of data are stored, processed, and transmitted to the ground station. An important approach to deal with massive volumes of information is an emerging technique, called compressive sensing, which acquires directly the compressed signal instead of acquiring the full dataset. Thus, reducing the amount of data that needs to be measured, transmitted, and stored in first place. In this article, a hardware/software implementation in a system-on-chip (SoC) field-programmable gate array (FPGA) for compressive sensing is proposed. The proposed hardware/software architecture runs the compressive sensing algorithm with a unitary compression rate over an airborne visible/infrared imaging spectrometer sensor image with 512 lines, 614 samples, and 224 bands in 0.35 s. The proposed system runs <inline-formula><tex-math notation="LaTeX">$\text{49}\times$</tex-math></inline-formula> and <inline-formula><tex-math notation="LaTeX">$\text{216}\times$</tex-math></inline-formula> faster than an embedded 256-cores GPU of a Jetson TX2 board and the ARM of the SoC FPGA, respectively. In terms of energy, the proposed architecture requires around <inline-formula><tex-math notation="LaTeX">$\text{100} \times$</tex-math></inline-formula> less energy.

[1]  Adrian Stern,et al.  Compressive Sensing Hyperspectral Imaging by Spectral Multiplexing with Liquid Crystal , 2018, J. Imaging.

[2]  Martin Chamberland,et al.  Toward UAV based compact thermal infrared hyperspectral imaging solution for real-time gas detection identification and quantification (Conference Presentation) , 2019 .

[3]  José Francisco López,et al.  Multispectral and Hyperspectral Lossless Compressor for Space Applications (HyLoC): A Low-Complexity FPGA Implementation of the CCSDS 123 Standard , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[4]  X. Ceamanos,et al.  Processing Hyperspectral Images , 2016 .

[5]  Raul Morais,et al.  Hyperspectral Imaging: A Review on UAV-Based Sensors, Data Processing and Applications for Agriculture and Forestry , 2017, Remote. Sens..

[6]  Roberto Sarmiento,et al.  Scalable Hardware-Based On-Board Processing for Run-Time Adaptive Lossless Hyperspectral Compression , 2019, IEEE Access.

[7]  Timothy Lillicrap,et al.  Deep Compressed Sensing , 2019, ICML.

[8]  Heather Quinn,et al.  Radiation effects in reconfigurable FPGAs , 2017 .

[9]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[10]  José M. P. Nascimento,et al.  Hyperspectral compressive sensing - A comparison of embedded GPU and ARM implementations , 2019 .

[11]  Tor Arne Johansen,et al.  An Efficient Real-Time FPGA Implementation of the CCSDS-123 Compression Standard for Hyperspectral Images , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[12]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[13]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[14]  Mark A. Richardson,et al.  An introduction to hyperspectral imaging and its application for security, surveillance and target acquisition , 2010 .

[15]  Lei Zhu,et al.  A Prediction-Based Spatial-Spectral Adaptive Hyperspectral Compressive Sensing Algorithm , 2018, Sensors.

[16]  José M. Bioucas-Dias,et al.  Hyperspectral image reconstruction from random projections on GPU , 2016, 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[17]  W. T. O'Hare,et al.  The application of visible wavelength reflectance hyperspectral imaging for the detection and identification of blood stains. , 2014, Science & justice : journal of the Forensic Science Society.

[18]  Enrico Magli,et al.  High-Throughput Onboard Hyperspectral Image Compression With Ground-Based CNN Reconstruction , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Enrico Magli,et al.  Low-complexity predictive lossy compression of hyperspectral and ultraspectral images , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Ming Yang,et al.  GPU Scheduling on the NVIDIA TX2: Hidden Details Revealed , 2017, 2017 IEEE Real-Time Systems Symposium (RTSS).

[21]  Antonio J. Plaza,et al.  The Promise of Reconfigurable Computing for Hyperspectral Imaging Onboard Systems: A Review and Trends , 2013, Proceedings of the IEEE.

[22]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Giljoo Nam,et al.  High-quality hyperspectral reconstruction using a spectral prior , 2017, ACM Trans. Graph..

[24]  Carlos González,et al.  FPGA Implementation of the CCSDS 1.2.3 Standard for Real-Time Hyperspectral Lossless Compression , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[25]  Richard G. Baraniuk,et al.  Sparsity and Structure in Hyperspectral Imaging : Sensing, Reconstruction, and Target Detection , 2014, IEEE Signal Processing Magazine.

[26]  Tor Arne Johansen,et al.  A Parallel FPGA Implementation of the CCSDS-123 Compression Algorithm , 2019, Remote. Sens..

[27]  Sebastián López,et al.  Real-Time Hyperspectral Image Compression Onto Embedded GPUs , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[28]  Wei Wei,et al.  Dictionary Learning for Promoting Structured Sparsity in Hyperspectral Compressive Sensing , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[29]  José M. P. Nascimento,et al.  Parallel hyperspectral image reconstruction using random projections , 2016, Remote Sensing.

[30]  Dong Liu,et al.  HSCNN: CNN-Based Hyperspectral Image Recovery from Spectrally Undersampled Projections , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[31]  Antonio Plaza,et al.  Low–High-Power Consumption Architectures for Deep-Learning Models Applied to Hyperspectral Image Classification , 2019, IEEE Geoscience and Remote Sensing Letters.

[32]  José M. Bioucas-Dias,et al.  Hyperspectral Blind Reconstruction From Random Spectral Projections , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[34]  Jinchao Chen,et al.  A Review of Hyperspectral Imaging for Chicken Meat Safety and Quality Evaluation: Application, Hardware, and Software. , 2019, Comprehensive reviews in food science and food safety.

[35]  Yonina C. Eldar,et al.  Structured Compressed Sensing: From Theory to Applications , 2011, IEEE Transactions on Signal Processing.

[36]  Sebastián López,et al.  A Novel Use of Hyperspectral Images for Human Brain Cancer Detection using in-Vivo Samples , 2016, BIOSIGNALS.

[37]  Qian Du,et al.  High Performance Computing for Hyperspectral Remote Sensing , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Jessica A. Faust,et al.  Imaging Spectroscopy and the Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) , 1998 .

[39]  Michael J. Wirthlin,et al.  High-Reliability FPGA-Based Systems: Space, High-Energy Physics, and Beyond , 2015, Proceedings of the IEEE.

[40]  Matthew Klimesh,et al.  Exploiting Calibration-Induced Artifacts in Lossless Compression of Hyperspectral Imagery , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Antonio J. Plaza,et al.  Parallel Hyperspectral Coded Aperture for Compressive Sensing on GPUs , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Shengli Zhou,et al.  Application of compressive sensing to sparse channel estimation , 2010, IEEE Communications Magazine.

[43]  David W. Messinger,et al.  Bloodstain detection and discrimination impacted by spectral shift when using an interference filter-based visible and near-infrared multispectral crime scene imaging system , 2018 .

[44]  José M. Bioucas-Dias,et al.  HYCA: A New Technique for Hyperspectral Compressive Sensing , 2015, IEEE Trans. Geosci. Remote. Sens..

[45]  José M. Bioucas-Dias,et al.  Does independent component analysis play a role in unmixing hyperspectral data? , 2003, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Antonios Paschalis,et al.  A 3.3 Gbps CCSDS 123.0-B-1 Multispectral & Hyperspectral Image Compression Hardware Accelerator on a Space-Grade SRAM FPGA , 2018, IEEE Transactions on Emerging Topics in Computing.

[47]  Da-Wen Sun,et al.  Application of Hyperspectral Imaging in Food Safety Inspection and Control: A Review , 2012, Critical reviews in food science and nutrition.

[48]  Sebastián López,et al.  A New Algorithm for the On-Board Compression of Hyperspectral Images , 2018, Remote. Sens..