A novel median based image impulse noise suppression system using spiking neurons on FPGA

ABSTRACT The most common impulse noise suppression methods are based on the median filter. They are suitable for low noise densities, but employing a separate noise detection step makes them suitable for higher noise rates. Instead, this may degrade the performance for lower noise. Particularly, the adaptive median noise removal algorithm improves the results for both low and high noise corruption rates. This paper presents a novel noise detection and filtering algorithm that uses leaky integrate and fire spiking neurons which model natural computing of the brain. In the proposed method, at each process of the detection and the filtering, all pixels of an adaptive sliding window are fed to the spiking neurons performing the operations in parallel. As a result, higher processing speed and higher operating frequency are achieved. An FPGA is used to implement the algorithm due to its real-time application and reconfigurable structure. The proposed architecture represents a slight increase in the PSNR values, whereas it consumes less hardware resources compared to the previous works. The design is implemented on Cyclone IV device from Altera family. It includes 3231 LUTs and the maximum operating frequency of 187 MHz is achieved.

[1]  Richard A. Haddad,et al.  Adaptive median filters: new algorithms and results , 1995, IEEE Trans. Image Process..

[2]  Hasan Demirel,et al.  Interpolation-based impulse noise removal , 2013, IET Image Process..

[3]  Zhou Wang,et al.  Video Denoising Based on a Spatiotemporal Gaussian Scale Mixture Model , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Kai-Kuang Ma,et al.  A switching median filter with boundary discriminative noise detection for extremely corrupted images , 2006, IEEE Trans. Image Process..

[5]  Peter J. Bentley,et al.  A Cellular Structure for Online Routing of Digital Spiking Neuron Axons and Dendrites on FPGAs , 2008, ICES.

[6]  Zhe Zhou,et al.  Cognition and Removal of Impulse Noise With Uncertainty , 2012, IEEE Transactions on Image Processing.

[7]  Filip Ponulak,et al.  Introduction to spiking neural networks: Information processing, learning and applications. , 2011, Acta neurobiologiae experimentalis.

[8]  Veerakumar Thangaraj,et al.  Removal of High Density Salt and Pepper Noise Through Modified Decision Based Unsymmetric Trimmed Median Filter , 2011, IEEE Signal Processing Letters.

[9]  Khalid A. Darabkh,et al.  Efficient Improvements on the BDND Filtering Algorithm for the Removal of High-Density Impulse Noise , 2013, IEEE Transactions on Image Processing.

[10]  Rutu Parekh,et al.  Noise Removing Filters and Its Implementation on FPGA , 2018 .

[11]  S. Baskar,et al.  An efficient approach for the removal of impulse noise from the corrupted image using neural network based impulse detector , 2010, Image Vis. Comput..

[12]  Dominik Sankowski,et al.  Noise adaptive switching median-based filter for impulse noise removal from extremely corrupted images , 2011 .

[13]  Raymond H. Chan,et al.  Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization , 2005, IEEE Transactions on Image Processing.

[14]  Theam Foo Ng,et al.  Simple adaptive median filter for the removal of impulse noise from highly corrupted images , 2008, IEEE Transactions on Consumer Electronics.

[15]  Wenbin Luo Efficient removal of impulse noise from digital images , 2006, IEEE Trans. Consumer Electron..

[16]  Jürgen Teich,et al.  A Novel Image Impulse Noise Removal Algorithm Optimized for Hardware Accelerators , 2017, J. Signal Process. Syst..

[17]  Bogdan Smolka,et al.  Fast averaging peer group filter for the impulsive noise removal in color images , 2015, Journal of Real-Time Image Processing.

[18]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[19]  Hong Liu,et al.  Quaternion-Based Impulse Noise Removal From Color Video Sequences , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Cem Kalyoncu,et al.  A weighted mean filter with spatial-bias elimination for impulse noise removal , 2015, Digit. Signal Process..

[21]  A. Willson,et al.  Median filters with adaptive length , 1988 .