Hardware Acceleration of Nonlocal Means-Based Speckle Noise Removal Applied to SAR Imagery

Removal of speckle noise from synthetic aperture radar (SAR) remains a challenging obstacle for onboard processing. Speckle noise is substantially harder to address than Gaussian noise due to its multiplicative nature. The probability patch-based (PPB) filter is based on the nonlocal means filter and can reduce speckle noise while preserving fine details. However, its high computational complexity inhibits its practical use in embedded applications. This is especially true for conventional space platforms, where radiation-hardened processors have significantly lower performance and energy-efficiency than their commercial-off-the-shelf counterparts. Combined with ever-increasing demands for data processing requirements and an emphasis on intelligent, autonomous systems, there is a need to enhance computing capabilities of space platforms for present and future missions. Recently, use of hybrid system-on-chip (SoC) devices in space applications has been increasingly adopted. Namely, CPU+FPGA devices present several opportunities for efficient acceleration of many applications in comparison to software-only architectures. In this paper, a detailed description of a CPU+FPGA accelerator for speckle noise removal implementing the PPB filter is presented. The proposed architecture leverages the strengths of CPUs and FPGAs to maximize performance. Studying the dataflow and computation properties of the algorithm allow for a highly parallelized and fully pipelined design. When evaluated on the Xilinx Z-7045 SoC, our proposed architecture shows a significant execution time improvement (up to ~750x) over a software-only baseline while maintaining modest FPGA resource utilization. To verify its function, filtering quality is evaluated using images artificially corrupted by simulated speckle noise as well as real SAR images. Quantitative analysis shows that use of the hardware design only introduces negligible quality loss.

[1]  Victor S. Frost,et al.  A Model for Radar Images and Its Application to Adaptive Digital Filtering of Multiplicative Noise , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Gary Crum,et al.  SpaceCube v3.0 NASA Next-Generation High-Performance Processor for Science Applications , 2019 .

[3]  Matthias Kuba,et al.  An FPGA-Based Fully Synchronized Design of a Bilateral Filter for Real-Time Image Denoising , 2014, IEEE Transactions on Industrial Electronics.

[4]  Florence Tupin,et al.  Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights , 2009, IEEE Transactions on Image Processing.

[5]  Jérôme Darbon,et al.  Fast nonlocal filtering applied to electron cryomicroscopy , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[6]  Luciano Alparone,et al.  A Tutorial on Speckle Reduction in Synthetic Aperture Radar Images , 2013, IEEE Geoscience and Remote Sensing Magazine.

[7]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  H. Guterman,et al.  FPGA-Based Adaptive Speckle Suppression Filter for Underwater Imaging Sonar , 2011, IEEE Journal of Oceanic Engineering.

[10]  I. Hajnsek,et al.  A tutorial on synthetic aperture radar , 2013, IEEE Geoscience and Remote Sensing Magazine.

[11]  Manolis I. A. Lourakis,et al.  High-Performance Embedded Computing in Space: Evaluation of Platforms for Vision-Based Navigation , 2018 .

[12]  Jong-Sen Lee,et al.  Digital Image Enhancement and Noise Filtering by Use of Local Statistics , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  E. Nezry,et al.  Maximum A Posteriori Speckle Filtering And First Order Texture Models In Sar Images , 1990, 10th Annual International Symposium on Geoscience and Remote Sensing.

[14]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[15]  Luisa Verdoliva,et al.  A Nonlocal SAR Image Denoising Algorithm Based on LLMMSE Wavelet Shrinkage , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Alan D. George,et al.  Onboard Processing With Hybrid and Reconfigurable Computing on Small Satellites , 2018, Proceedings of the IEEE.

[17]  S.T. Acton,et al.  Real-Time Processing of Ultrasound Images with Speckle Reducing Anisotropic Diffusion , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.