A Novel FPGA-Based Architecture for Fast Automatic Target Detection in Hyperspectral Images

Onboard target detection of hyperspectral imagery (HSI), considered as a significant remote sensing application, has gained increasing attention in the latest years. It usually requires processing huge volumes of HSI data in real-time under constraints of low computational complexity and high detection accuracy. Automatic target generation process based on an orthogonal subspace projector (ATGP-OSP) is a well-known automatic target detection algorithm, which is widely used owing to its competitive performance. However, ATGP-OSP has an issue to be deployed onboard in real-time target detection due to its iteratively calculating the inversion of growing matrices and increasing matrix multiplications. To resolve this dilemma, we propose a novel fast implementation of ATGP (Fast-ATGP) while maintaining target detection accuracy of ATGP-OSP. Fast-ATGP takes advantage of simple regular matrix add/multiply operations instead of increasingly complicated matrix inversions to update growing orthogonal projection operator matrices. Furthermore, the updated orthogonal projection operator matrix is replaced by a normalized vector to perform the inner-product operations with each pixel for finding a target per iteration. With these two major optimizations, the computational complexity of ATGP-OSP is substantially reduced. What is more, an FPGA-based implementation of the proposed Fast-ATGP using high-level synthesis (HLS) is developed. Specifically, an efficient architecture containing a bunch of pipelines being executed in parallel is further designed and evaluated on a Xilinx XC7VX690T FPGA. The experimental results demonstrate that our proposed FPGA-based Fast-ATGP is able to automatically detect multiple targets on a commonly used dataset (AVIRIS Cuprite Data) at a high-speed rate of 200 MHz with a significant speedup of nearly 34.3 times that of ATGP-OSP, while retaining nearly the same high detection accuracy.

[1]  Xiaorun Li,et al.  Recursive Local Summation of RX Detection for Hyperspectral Image Using Sliding Windows , 2018, Remote. Sens..

[2]  José Francisco López,et al.  Multispectral and Hyperspectral Lossless Compressor for Space Applications (HyLoC): A Low-Complexity FPGA Implementation of the CCSDS 123 Standard , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Jason Cong,et al.  High-Level Synthesis for FPGAs: From Prototyping to Deployment , 2011, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[4]  Shihong Du,et al.  Spectral–Spatial Feature Extraction for Hyperspectral Image Classification: A Dimension Reduction and Deep Learning Approach , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Chein-I Chang,et al.  Automatic spectral target recognition in hyperspectral imagery , 2003 .

[7]  Chein-I Chang,et al.  A Deep Pipelined Implementation of Hyperspectral Target Detection Algorithm on FPGA Using HLS , 2018, Remote. Sens..

[8]  Antonio J. Plaza,et al.  FPGA Implementation of an Algorithm for Automatically Detecting Targets in Remotely Sensed Hyperspectral Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Chein-I Chang,et al.  Recursive Band Processing of Automatic Target Generation Process for Finding Unsupervised Targets in Hyperspectral Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Stein M. Nornes,et al.  First hyperspectral imaging survey of the deep seafloor: High-resolution mapping of manganese nodules , 2018 .

[11]  Yunsong Li,et al.  High-quality spectral-spatial reconstruction using saliency detection and deep feature enhancement , 2019, Pattern Recognit..

[12]  Antonio J. Plaza,et al.  GPU Implementation of an Automatic Target Detection and Classification Algorithm for Hyperspectral Image Analysis , 2013, IEEE Geoscience and Remote Sensing Letters.

[13]  Chein-I Chang,et al.  Progressive Band Processing of Fast Iterative Pixel Purity Index for Finding Endmembers , 2017, IEEE Geoscience and Remote Sensing Letters.

[14]  Chein-I Chang,et al.  Recursive Automatic Target Generation Process in Subpixel Detection , 2015, IEEE Geoscience and Remote Sensing Letters.

[15]  Kai Liu,et al.  Fast FPGA Implementation for Computing the Pixel Purity Index of Hyperspectral Images , 2018, J. Circuits Syst. Comput..

[16]  Qian Du,et al.  A Randomized Subspace Learning Based Anomaly Detector for Hyperspectral Imagery , 2018, Remote. Sens..

[17]  Vladan Velisavljevic,et al.  Real-Time Refocusing Using an FPGA-Based Standard Plenoptic Camera , 2018, IEEE Transactions on Industrial Electronics.

[18]  Haokui Zhang,et al.  Spectral-spatial classification of hyperspectral imagery using a dual-channel convolutional neural network , 2017 .

[19]  Roberto Sarmiento,et al.  A FPGA implementation for linearly unmixing a hyperspectral image using OpenCL , 2017, Remote Sensing.

[20]  Chein-I Chang,et al.  Comparative Study and Analysis Among ATGP, VCA, and SGA for Finding Endmembers in Hyperspectral Imagery , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Luyan Ji,et al.  A Piecewise Linear Strategy of Target Detection for Multispectral/Hyperspectral Image , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[22]  Kai Zhao,et al.  Massively Parallel GPU Design of Automatic Target Generation Process in Hyperspectral Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[23]  Lianru Gao,et al.  A novel anomaly detection method incorporating target information derived from hyperspectral imagery , 2016 .

[24]  Venkata Dinavahi,et al.  FPGA-Based Real-Time Wrench Model of Direct Current Driven Magnetic Levitation Actuator , 2018, IEEE Transactions on Industrial Electronics.

[25]  Antonio J. Plaza,et al.  Special issue on architectures and techniques for real-time processing of remotely sensed images , 2009, Journal of Real-Time Image Processing.

[26]  Gang Yang,et al.  A Sparse and Low-Rank Near-Isometric Linear Embedding Method for Feature Extraction in Hyperspectral Imagery Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Chein-I Chang,et al.  Band-Specified Virtual Dimensionality for Band Selection: An Orthogonal Subspace Projection Approach , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Liang-pei Zhang,et al.  A Poisson nonnegative matrix factorization method with parameter subspace clustering constraint for endmember extraction in hyperspectral imagery , 2017 .

[29]  Yu Ting Chen,et al.  A Survey and Evaluation of FPGA High-Level Synthesis Tools , 2016, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[30]  Yunsong Li,et al.  Hyperspectral image reconstruction by deep convolutional neural network for classification , 2017, Pattern Recognit..

[31]  Chein-I Chang,et al.  Random N-Finder (N-FINDR) Endmember Extraction Algorithms for Hyperspectral Imagery , 2011, IEEE Transactions on Image Processing.

[32]  Sebastián López,et al.  A novel FPGA-based architecture for the estimation of the virtual dimensionality in remotely sensed hyperspectral images , 2014, Journal of Real-Time Image Processing.

[33]  Nasser M. Nasrabadi,et al.  Hyperspectral Target Detection : An Overview of Current and Future Challenges , 2014, IEEE Signal Processing Magazine.

[34]  Guillaume Roussel,et al.  Comparison of two atmospheric correction methods for the classification of spaceborne urban hyperspectral data depending on the spatial resolution , 2018 .

[35]  Ying Wang,et al.  Structured Sparse Method for Hyperspectral Unmixing , 2014, ArXiv.

[36]  Sebastián López,et al.  On the Evaluation of Different High-Performance Computing Platforms for Hyperspectral Imaging: An OpenCL-Based Approach , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Chein-I Chang,et al.  A Review of Virtual Dimensionality for Hyperspectral Imagery , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[38]  Naoto Yokoya,et al.  Advances in Hyperspectral Image and Signal Processing: A Comprehensive Overview of the State of the Art , 2017, IEEE Geoscience and Remote Sensing Magazine.

[39]  Sen Ma,et al.  Parallelizing maximum likelihood classification (MLC) for supervised image classification by pipelined thread approach through high-level synthesis (HLS) on FPGA cluster , 2018 .

[40]  Eric Truslow,et al.  Detection Algorithms in Hyperspectral Imaging Systems: An Overview of Practical Algorithms , 2014, IEEE Signal Processing Magazine.

[41]  Antonio J. Plaza,et al.  Dual-Mode FPGA Implementation of Target and Anomaly Detection Algorithms for Real-Time Hyperspectral Imaging , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.