Real-time algorithm for Poissonian noise reduction in low-dose fluoroscopy: performance evaluation

BackgroundQuantum noise intrinsically limits the quality of fluoroscopic images. The lower is the X-ray dose the higher is the noise. Fluoroscopy video processing can enhance image quality and allows further patient’s dose lowering. This study aims to assess the performances achieved by a Noise Variance Conditioned Average (NVCA) spatio-temporal filter for real-time denoising of fluoroscopic sequences. The filter is specifically designed for quantum noise suppression and edge preservation. It is an average filter that excludes neighborhood pixel values exceeding noise statistic limits, by means of a threshold which depends on the local noise standard deviation, to preserve the image spatial resolution. The performances were evaluated in terms of contrast-to-noise-ratio (CNR) increment, image blurring (full width of the half maximum of the line spread function) and computational time. The NVCA filter performances were compared to those achieved by simple moving average filters and the state-of-the-art video denoising block matching-4D (VBM4D) algorithm. The influence of the NVCA filter size and threshold on the final image quality was evaluated too.ResultsFor NVCA filter mask size of 5 × 5 × 5 pixels (the third dimension represents the temporal extent of the filter) and a threshold level equal to 2 times the local noise standard deviation, the NVCA filter achieved a 10% increase of the CNR with respect to the unfiltered sequence, while the VBM4D achieved a 14% increase. In the case of NVCA, the edge blurring did not depend on the speed of the moving objects; on the other hand, the spatial resolution worsened of about 2.2 times by doubling the objects speed with VBM4D. The NVCA mask size and the local noise-threshold level are critical for final image quality. The computational time of the NVCA filter was found to be just few percentages of that required for the VBM4D filter.ConclusionsThe NVCA filter obtained a better image quality compared to simple moving average filters, and a lower but comparable quality when compared with the VBM4D filter. The NVCA filter showed to preserve edge sharpness, in particular in the case of moving objects (performing even better than VBM4D). The simplicity of the NVCA filter and its low computational burden make this filter suitable for real-time video processing and its hardware implementation is ready to be included in future fluoroscopy devices, offering further lowering of patient’s X-ray dose.

[1]  M Grass,et al.  Noise reduction angiographic imaging technology reduces radiation dose during bronchial artery embolization. , 2017, European journal of radiology.

[2]  Alessandro Foi,et al.  Gaussian-Cauchy mixture modeling for robust signal-dependent noise estimation , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Alessandro Foi,et al.  Optimal Inversion of the Generalized Anscombe Transformation for Poisson-Gaussian Noise , 2013, IEEE Transactions on Image Processing.

[4]  Jürgen Weese,et al.  Voxel-based 2-D/3-D registration of fluoroscopy images and CT scans for image-guided surgery , 1997, IEEE Transactions on Information Technology in Biomedicine.

[5]  Karen O. Egiazarian,et al.  Video Denoising, Deblocking, and Enhancement Through Separable 4-D Nonlocal Spatiotemporal Transforms , 2012, IEEE Transactions on Image Processing.

[6]  Rolf-Rainer Grigat,et al.  Modeling and real-time estimation of signal-dependent noise in quantum-limited imaging , 2007 .

[7]  Jochen Michaelsen,et al.  P3354Significant reduction of radiation dosage in device implantation procedures using image noise reduction technology , 2017 .

[8]  Michel Desvignes,et al.  Spatio-Temporal Multiscale Denoising of Fluoroscopic Sequence , 2016, IEEE Transactions on Medical Imaging.

[9]  K. Egiazarian,et al.  Noise Measurement for Raw-Data of Digital Imaging Sensors by Automatic Segmentation of Nonuniform Targets , 2007, IEEE Sensors Journal.

[10]  Jonathan T. Barron,et al.  Burst Denoising with Kernel Prediction Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[11]  Karen O. Egiazarian,et al.  Pointwise Shape-Adaptive DCT for High-Quality Denoising and Deblocking of Grayscale and Color Images , 2007, IEEE Transactions on Image Processing.

[12]  Moon Gi Kang,et al.  Edge enhancement algorithm for low-dose X-ray fluoroscopic imaging , 2017, Comput. Methods Programs Biomed..

[13]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[14]  Petros Maragos,et al.  Bayesian Inference on Multiscale Models for Poisson Intensity Estimation: Applications to Photon-Limited Image Denoising , 2009, IEEE Transactions on Image Processing.

[15]  Gabor Fichtinger,et al.  Seed localization in Ultrasound and Registration to C-Arm Fluoroscopy Using Matched Needle Tracks for Prostate Brachytherapy , 2012, IEEE Transactions on Biomedical Engineering.

[16]  Paolo Bifulco,et al.  A comparison of denoising methods for X-ray fluoroscopic images , 2012, Biomed. Signal Process. Control..

[17]  Nassir Navab,et al.  A photon recycling approach to the denoising of ultra-low dose X-ray sequences , 2018, International Journal of Computer Assisted Radiology and Surgery.

[18]  Daniel Cremers,et al.  Efficient Nonlocal Means for Denoising of Textural Patterns , 2008, IEEE Transactions on Image Processing.

[19]  David L. Wilson,et al.  X-ray fluoroscopy spatio-temporal filtering with object detection , 1995, IEEE Trans. Medical Imaging.

[20]  J Wang,et al.  The AAPM/RSNA physics tutorial for residents: X-ray image intensifiers for fluoroscopy. , 2000, Radiographics : a review publication of the Radiological Society of North America, Inc.

[21]  Stefan Harmeling,et al.  Image denoising: Can plain neural networks compete with BM3D? , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  M Stasi,et al.  Patient's Peak Skin Dose evaluation using Gafchromic films in interventional cardiology procedures and its correlation with other dose indicators. , 2018, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[23]  A. A. Sawchuk,et al.  Nonlinear Restoration Of Filtered Images With Poisson Noise , 1979, Optics & Photonics.

[24]  Adrian Barbu,et al.  RENOIR - A dataset for real low-light image noise reduction , 2014, J. Vis. Commun. Image Represent..

[25]  Lei Zhu,et al.  Noise reduction in low-dose x-ray fluoroscopy for image-guided radiation therapy. , 2009, International journal of radiation oncology, biology, physics.

[26]  Sung-Fang Tsai,et al.  Real- Time Video Denoising on Mobile Phones , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[27]  Moon Gi Kang,et al.  Motion-adaptive 3D nonlocal means filter based on stochastic distance for low-dose X-ray fluoroscopy , 2017, Biomed. Signal Process. Control..

[28]  Luigi Paura,et al.  X-ray fluoroscopy noise modeling for filter design , 2013, International Journal of Computer Assisted Radiology and Surgery.

[29]  Maria Romano,et al.  A continuous description of intervertebral motion by means of spline interpolation of kinematic data extracted by videofluoroscopy. , 2012, Journal of biomechanics.

[30]  Volker Strassen,et al.  Algebraic Complexity Theory , 1991, Handbook of Theoretical Computer Science, Volume A: Algorithms and Complexity.

[31]  Tingting Zhao,et al.  Ultra‐low‐dose CT image denoising using modified BM3D scheme tailored to data statistics , 2018, Medical physics.

[32]  G. Cayla,et al.  Assessment of Patient's Peak Skin Dose Using Gafchromic Films During Interventional Cardiology Procedures: Routine Experience Feedback , 2016, Radiation protection dosimetry.

[33]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[34]  Michael Clausen,et al.  Algebraic complexity theory , 1997, Grundlehren der mathematischen Wissenschaften.

[35]  Jian Yu,et al.  A Dictionary Learning Approach for Poisson Image Deblurring , 2013, IEEE Transactions on Medical Imaging.

[36]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[37]  Paul A Midgley,et al.  Denoising time-resolved microscopy image sequences with singular value thresholding. , 2017, Ultramicroscopy.

[38]  Mikhail J. Atallah,et al.  Algorithms and Theory of Computation Handbook , 2009, Chapman & Hall/CRC Applied Algorithms and Data Structures series.

[39]  M. Tapiovaara SNR and noise measurements for medical imaging. II. Application to fluoroscopic X-ray equipment , 1993 .

[40]  Nelson D. A. Mascarenhas,et al.  A Nonlocal Poisson Denoising Algorithm Based on Stochastic Distances , 2013, IEEE Signal Processing Letters.

[41]  Alessandro Foi,et al.  Optimal Inversion of the Anscombe Transformation in Low-Count Poisson Image Denoising , 2011, IEEE Transactions on Image Processing.

[42]  J. Coatrieux,et al.  Improving Low-dose Cardiac CT Images based on 3D Sparse Representation , 2016, Scientific Reports.

[43]  Michael Becker,et al.  Image noise reduction technology allows significant reduction of radiation dosage in cardiac device implantation procedures , 2017, Pacing and clinical electrophysiology : PACE.

[44]  Paolo Bifulco,et al.  An FPGA-Oriented Algorithm for Real-Time Filtering of Poisson Noise in Video Streams, with Application to X-Ray Fluoroscopy , 2019, Circuits Syst. Signal Process..

[45]  P Bifulco,et al.  Advanced template matching method for estimation of intervertebral kinematics of lumbar spine. , 2011, Medical engineering & physics.

[46]  Mahmoud R. El-Sakka,et al.  Improved BM3D image denoising using SSIM-optimized Wiener filter , 2018, EURASIP J. Image Video Process..

[47]  Hideki Yoshikawa,et al.  Improvement of depth position in 2-D/3-D registration of knee implants using single-plane fluoroscopy , 2004, IEEE Transactions on Medical Imaging.

[48]  Mizuho Nishio,et al.  Convolutional auto-encoder for image denoising of ultra-low-dose CT , 2017, Heliyon.

[49]  Karen O. Egiazarian,et al.  Image denoising with block-matching and 3D filtering , 2006, Electronic Imaging.

[50]  Maria Romano,et al.  Hardware implementation of a spatio-temporal average filter for real-time denoising of fluoroscopic images , 2015, Integr..

[51]  F. Plank,et al.  Reduction of fluoroscopy dose for cardiac electrophysiology procedures: A feasibility and safety study. , 2019, European journal of radiology.

[52]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[53]  Sebastian Schafer,et al.  Noise reduction for curve-linear structures in real time fluoroscopy applications using directional binary masks. , 2015, Medical physics.

[54]  Karen O. Egiazarian,et al.  Video denoising using separable 4D nonlocal spatiotemporal transforms , 2011, Electronic Imaging.