Noise-Aware and Light-Weight VLSI Design of Bilateral Filter for Robust and Fast Image Denoising in Mobile Systems

The range kernel of bilateral filter degrades image quality unintentionally in real environments because the pixel intensity varies randomly due to the noise that is generated in image sensors. Furthermore, the range kernel increases the complexity due to the comparisons with neighboring pixels and the multiplications with the corresponding weights. In this paper, we propose a noise-aware range kernel, which estimates noise using an intensity difference-based image noise model and dynamically adjusts weights according to the estimated noise, in order to alleviate the quality degradation of bilateral filters by noise. In addition, to significantly reduce the complexity, an approximation scheme is introduced, which converts the proposed noise-aware range kernel into a binary kernel while using the statistical hypothesis test method. Finally, blue a fully parallelized and pipelined very-large-scale integration (VLSI) architecture of a noise-aware bilateral filter (NABF) that is based on the proposed binary range kernel is presented, which was successfully implemented in field-programmable gate array (FPGA). The experimental results show that the proposed NABF is more robust to noise than the conventional bilateral filter under various noise conditions. Furthermore, the proposed VLSI design of the NABF achieves 10.5 and 95.7 times higher throughput and uses 63.6–97.5% less internal memory than state-of-the-art bilateral filter designs.

[1]  Ye Chen,et al.  Optimization of Bilateral Filter Parameters via Chi-Square Unbiased Risk Estimate , 2014, IEEE Signal Processing Letters.

[2]  Mahmoud R. El-Sakka,et al.  Improved BM3D image denoising using SSIM-optimized Wiener filter , 2018, EURASIP J. Image Video Process..

[3]  Youngbae Hwang,et al.  Difference-Based Image Noise Modeling Using Skellam Distribution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Jürgen Teich,et al.  A Design Methodology for Hardware Acceleration of Adaptive Filter Algorithms in Image Processing , 2006, IEEE 17th International Conference on Application-specific Systems, Architectures and Processors (ASAP'06).

[5]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[6]  Yu-Ju Lin,et al.  An Automatic Parameter Decision System of Bilateral Filtering with GPU-Based Acceleration for Brain MR Images , 2018, Journal of Digital Imaging.

[7]  Lionel Lacassagne,et al.  A New Real-Time Embedded Video Denoising Algorithm , 2019, 2019 Conference on Design and Architectures for Signal and Image Processing (DASIP).

[8]  G. N. Rathna,et al.  A Reconfigurable and Scalable FPGA Architecture for Bilateral Filtering , 2018, IEEE Transactions on Industrial Electronics.

[9]  Tian-Sheuan Chang,et al.  A 124 Mpixels/s VLSI Design for Histogram-Based Joint Bilateral Filtering , 2011, IEEE Transactions on Image Processing.

[10]  Yunfang Zhu,et al.  Dynamic Residual Dense Network for Image Denoising , 2019, Sensors.

[11]  Honghong Peng,et al.  Bilateral kernel parameter optimization by risk minimization , 2010, 2010 IEEE International Conference on Image Processing.

[12]  Xianming Liu,et al.  Connecting Image Denoising and High-Level Vision Tasks via Deep Learning , 2018, IEEE Transactions on Image Processing.

[13]  Stamatios Lefkimmiatis,et al.  Universal Denoising Networks : A Novel CNN Architecture for Image Denoising , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  I. Laptev,et al.  Towards reliable object detection in noisy images , 2017, Pattern Recognition and Image Analysis.

[15]  Chandra Sekhar Seelamantula,et al.  Optimal parameter selection for bilateral filters using Poisson Unbiased Risk Estimate , 2012, 2012 19th IEEE International Conference on Image Processing.

[16]  Seong-Won Lee,et al.  A parallel camera image signal processor for SIMD architecture , 2016, EURASIP J. Image Video Process..

[17]  Fatih Porikli,et al.  Constant time O(1) bilateral filtering , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Sunil Agrawal,et al.  Image denoising review: From classical to state-of-the-art approaches , 2020, Inf. Fusion.

[19]  Patrick J. Wolfe,et al.  Chi-square unbiased risk estimate for denoising magnitude MR images , 2011, 2011 18th IEEE International Conference on Image Processing.

[20]  Matthias Kuba,et al.  An FPGA-Based Fully Synchronized Design of a Bilateral Filter for Real-Time Image Denoising , 2014, IEEE Transactions on Industrial Electronics.

[21]  Takeo Kanade,et al.  Statistical Calibration of the CCD Imaging Process , 2001, ICCV.

[22]  S. Goodman,et al.  Statistical tests, P values, confidence intervals, and power: a guide to misinterpretations , 2016, European Journal of Epidemiology.

[23]  Kunal N. Chaudhury,et al.  Fast and Provably Accurate Bilateral Filtering , 2016, IEEE Transactions on Image Processing.