An FPGA-Oriented Algorithm for Real-Time Filtering of Poisson Noise in Video Streams, with Application to X-Ray Fluoroscopy

In this paper we propose a new algorithm for real-time filtering of video sequences corrupted by Poisson noise. The algorithm provides effective denoising (in some cases overcoming the filtering performances of state-of-the-art techniques), is ideally suited for hardware implementation, and can be implemented on a small field-programmable gate array using limited hardware resources. The paper describes the proposed algorithm, using X-ray fluoroscopy as a case study. We use IIR filters for time filtering, which largely simplifies hardware cost with respect to previous FIR filter-based implementations. A conditional reset is implemented in the IIR filter, to minimize motion blur, with the help of an adaptive thresholding approach. Spatial filtering performs a conditional mean to further reduce noise and to remove isolated noisy pixels. IIR filter hardware implementation is optimized by using a novel technique, based on Steiglitz–McBride iterative method, to calculate fixed-point filter coefficients with minimal number of nonzero elements. Implementation results using the smallest StratixIV FPGA show that the system uses only, at most, the 22% of the resources of the device, while performing real-time filtering of 1024 × 1024@49fps video stream. For comparison, a previous FIR filter-based implementation, on the same FPGA, in the same conditions and constraints (1024 × 1024@49fps), requires the 80% of the logic resources of the FPGA.

[1]  A. A. Sawchuk,et al.  Nonlinear Restoration Of Filtered Images With Poisson Noise , 1979, Optics & Photonics.

[2]  T. W. Parks,et al.  Digital Filter Design , 1987 .

[3]  Hideki Yoshikawa,et al.  Improvement of depth position in 2-D/3-D registration of knee implants using single-plane fluoroscopy , 2004, IEEE Transactions on Medical Imaging.

[4]  Suyash P. Awate,et al.  Higher-order image statistics for unsupervised, information-theoretic, adaptive, image filtering , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  José M. Bioucas-Dias,et al.  Restoration of Poissonian Images Using Alternating Direction Optimization , 2010, IEEE Transactions on Image Processing.

[6]  C J Kotre,et al.  Noise and threshold contrast characteristics of a digital fluorographic system. , 1986, Physics in medicine and biology.

[7]  P Bifulco,et al.  Advanced template matching method for estimation of intervertebral kinematics of lumbar spine. , 2011, Medical engineering & physics.

[8]  Luigi Paura,et al.  Noise reduction in fluoroscopic image sequences for joint kinematics analysis , 2010 .

[9]  Mohammed Ghazal,et al.  Structure-Oriented Multidirectional Wiener Filter for Denoising of Image and Video Signals , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  M. Tapiovaara SNR and noise measurements for medical imaging. II. Application to fluoroscopic X-ray equipment , 1993 .

[11]  Karen O. Egiazarian,et al.  Video denoising by sparse 3D transform-domain collaborative filtering , 2007, 2007 15th European Signal Processing Conference.

[12]  Nelson D. A. Mascarenhas,et al.  A Nonlocal Poisson Denoising Algorithm Based on Stochastic Distances , 2013, IEEE Signal Processing Letters.

[13]  Alessandro Foi,et al.  Optimal Inversion of the Anscombe Transformation in Low-Count Poisson Image Denoising , 2011, IEEE Transactions on Image Processing.

[14]  Aggelos K. Katsaggelos,et al.  Image sequence filtering in quantum-limited noise with applications to low-dose fluoroscopy , 1993, IEEE Trans. Medical Imaging.

[15]  J Wang,et al.  The AAPM/RSNA physics tutorial for residents: X-ray image intensifiers for fluoroscopy. , 2000, Radiographics : a review publication of the Radiological Society of North America, Inc.

[16]  H. Kwan,et al.  Minimax Design of IIR Digital Filters Using Iterative SOCP , 2010 .

[17]  S. Osher,et al.  Image restoration: Total variation, wavelet frames, and beyond , 2012 .

[18]  John G. Proakis,et al.  Digital Signal Processing: Principles, Algorithms, and Applications , 1992 .

[19]  Thierry Blu,et al.  Image Denoising in Mixed Poisson–Gaussian Noise , 2011, IEEE Transactions on Image Processing.

[20]  Alessandro Foi,et al.  Optimal Inversion of the Generalized Anscombe Transformation for Poisson-Gaussian Noise , 2013, IEEE Transactions on Image Processing.

[21]  Aleksandra Pizurica,et al.  Wavelet-Domain Video Denoising Based on Reliability Measures , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  G. R. Sinha,et al.  Medical Image Denoising Using Bilateral Filter , 2012 .

[23]  S. Loncaric,et al.  Adaptive spatio-temporal denoising of fluoroscopic X-ray sequences , 2012, Biomed. Signal Process. Control..

[24]  Alessandro Foi,et al.  Clipped noisy images: Heteroskedastic modeling and practical denoising , 2009, Signal Process..

[25]  Mathias C. Lang,et al.  Least-squares design of IIR filters with prescribed magnitude and phase responses and a pole radius constraint , 2000, IEEE Trans. Signal Process..

[26]  L. Mcbride,et al.  A technique for the identification of linear systems , 1965 .

[27]  Sen M. Kuo,et al.  Real-time digital signal processing , 2001 .

[28]  Yu Liu,et al.  Video Denoising Based on a Spatiotemporal Kalman-Bilateral Mixture Model , 2013, TheScientificWorldJournal.

[29]  Paolo Bifulco,et al.  A comparison of denoising methods for X-ray fluoroscopic images , 2012, Biomed. Signal Process. Control..

[30]  Tong Lin,et al.  低ビットレートビデオ会議に対する関心領域利用レート制御 | 文献情報 | J-GLOBAL 科学技術総合リンクセンター , 2006 .

[31]  Maria Romano,et al.  Hardware implementation of a spatio-temporal average filter for real-time denoising of fluoroscopic images , 2015, Integr..

[32]  W. M. Hubbard,et al.  The approximation of a Poisson distribution by a Gaussian distribution , 1970 .

[33]  David L. Wilson,et al.  X-ray fluoroscopy spatio-temporal filtering with object detection , 1995, IEEE Trans. Medical Imaging.

[34]  Mohamed-Jalal Fadili,et al.  Wavelets, Ridgelets, and Curvelets for Poisson Noise Removal , 2008, IEEE Transactions on Image Processing.

[35]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[36]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[37]  Aleksandra Pizurica,et al.  Fuzzy logic recursive motion detection and denoising of video sequences , 2006, J. Electronic Imaging.

[38]  Valeria Ruggiero,et al.  An alternating extragradient method for total variation-based image restoration from Poisson data , 2011 .

[39]  Luigi Paura,et al.  X-ray fluoroscopy noise modeling for filter design , 2013, International Journal of Computer Assisted Radiology and Surgery.

[40]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[41]  Mostafa Kaveh,et al.  Fourth-order partial differential equations for noise removal , 2000, IEEE Trans. Image Process..

[42]  Gabor Fichtinger,et al.  Seed localization in Ultrasound and Registration to C-Arm Fluoroscopy Using Matched Needle Tracks for Prostate Brachytherapy , 2012, IEEE Transactions on Biomedical Engineering.

[43]  Zhou Wang,et al.  Video Denoising Based on a Spatiotemporal Gaussian Scale Mixture Model , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[44]  Yuan F. Zheng,et al.  Combined spatial and temporal domain wavelet shrinkage algorithm for video denoising , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[45]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[46]  Thomas Brox,et al.  On the Equivalence of Soft Wavelet Shrinkage, Total Variation Diffusion, Total Variation Regularization, and SIDEs , 2004, SIAM J. Numer. Anal..