Patch-Based Nonlocal Functional for Denoising Fluorescence Microscopy Image Sequences

We present a nonparametric regression method for denoising 3-D image sequences acquired via fluorescence microscopy. The proposed method exploits the redundancy of the 3-D+time information to improve the signal-to-noise ratio of images corrupted by Poisson-Gaussian noise. A variance stabilization transform is first applied to the image-data to remove the dependence between the mean and variance of intensity values. This preprocessing requires the knowledge of parameters related to the acquisition system, also estimated in our approach. In a second step, we propose an original statistical patch-based framework for noise reduction and preservation of space-time discontinuities. In our study, discontinuities are related to small moving spots with high velocity observed in fluorescence video-microscopy. The idea is to minimize an objective nonlocal energy functional involving spatio-temporal image patches. The minimizer has a simple form and is defined as the weighted average of input data taken in spatially-varying neighborhoods. The size of each neighborhood is optimized to improve the performance of the pointwise estimator. The performance of the algorithm (which requires no motion estimation) is then evaluated on both synthetic and real image sequences using qualitative and quantitative criteria.

[1]  F. J. Anscombe,et al.  THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATA , 1948 .

[2]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[3]  Jong-Sen Lee,et al.  Speckle analysis and smoothing of synthetic aperture radar images , 1981 .

[4]  D. Agard Optical sectioning microscopy: cellular architecture in three dimensions. , 1984, Annual review of biophysics and bioengineering.

[5]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  T. Gasser,et al.  Residual variance and residual pattern in nonlinear regression , 1986 .

[7]  Peter J. Rousseeuw,et al.  Robust Regression and Outlier Detection , 2005, Wiley Series in Probability and Statistics.

[8]  M. Newberry SIGNAL-TO-NOISE CONSIDERATIONS FOR SKY-SUBTRACTED CCD DATA , 1991 .

[9]  Aggelos K. Katsaggelos,et al.  Image sequence filtering in quantum-limited noise with applications to low-dose fluoroscopy , 1993, IEEE Trans. Medical Imaging.

[10]  Aggelos K. Katsaggelos,et al.  Noise reduction filters for dynamic image sequences: a review , 1995, Proc. IEEE.

[11]  Fionn Murtagh,et al.  Image restoration with noise suppression using a multiresolution support. , 1995 .

[12]  Fionn Murtagh,et al.  Automatic Noise Estimation from the Multiresolution Support , 1998 .

[13]  Suk Ho Lee,et al.  Spatio-temporal video filtering algorithm based on 3-D anisotropic diffusion equation , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[14]  Fionn Murtagh,et al.  Image Processing and Data Analysis - The Multiscale Approach , 1998 .

[15]  Narendra Ahuja,et al.  Video denoising by combining Kalman and Wiener estimates , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[16]  Patrick Pérez,et al.  Spatio-temporal Wiener filtering of image sequences using a parametric motion model , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[17]  D. Murphy Fundamentals of Light Microscopy and Electronic Imaging , 2001 .

[18]  Linda H. Zhao,et al.  Root-Unroot Methods for Nonparametric Density Estimation and Poisson Random-Effects Models , 2002 .

[19]  Jean-Baptiste Sibarita,et al.  Ultra-fast 4D microscopy and high throughput distributed deconvolution , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[20]  M. Jansen Multiscale Poisson data smoothing , 2006 .

[21]  Robert D. Nowak,et al.  Platelets: a multiscale approach for recovering edges and surfaces in photon-limited medical imaging , 2003, IEEE Transactions on Medical Imaging.

[22]  B. Jähne,et al.  Spatiotemporal anisotropic diffusion filtering to improve signal-to-noise ratios and object restoration in fluorescence microscopic image sequences. , 2003, Journal of biomedical optics.

[23]  Ljubisa Stankovic,et al.  Performance analysis of the adaptive algorithm for bias-to-variance tradeoff , 2004, IEEE Transactions on Signal Processing.

[24]  G. Nason,et al.  A Haar-Fisz Algorithm for Poisson Intensity Estimation , 2004 .

[25]  Fei Shi,et al.  Video denoising using oriented complex wavelet transforms , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[26]  M. Bershady,et al.  SparsePak: A Formatted Fiber Field Unit for the WIYN Telescope Bench Spectrograph. I. Design, Construction, and Calibration , 2004, astro-ph/0403456.

[27]  Nasir M. Rajpoot,et al.  Adaptive wavelet restoration of noisy video sequences , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[28]  Hye-Yeon Cheong,et al.  Adaptive spatio-temporal filtering for video denoising , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[29]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[30]  Eli Shechtman,et al.  Space-time video completion , 2004, CVPR 2004.

[31]  Vladimir Zlokolica,et al.  Motion- and detail-adaptive denoising of video , 2004, IS&T/SPIE Electronic Imaging.

[32]  Guillermo Sapiro,et al.  Fast image and video denoising via nonlocal means of similar neighborhoods , 2005, IEEE Signal Processing Letters.

[33]  J. Boulanger,et al.  Local adaptivity to variable smoothness for exemplar-based image denoising and representation , 2005 .

[34]  A. Kuznetsov,et al.  FRET-based voltage probes for confocal imaging: membrane potential oscillations throughout pancreatic islets. , 2005, American journal of physiology. Cell physiology.

[35]  Giovanni Motta,et al.  The DUDE framework for continuous tone image denoising , 2005, IEEE International Conference on Image Processing 2005.

[36]  J. Sibarita Deconvolution microscopy. , 2005, Advances in biochemical engineering/biotechnology.

[37]  Stanley Osher,et al.  Deblurring and Denoising of Images by Nonlocal Functionals , 2005, Multiscale Model. Simul..

[38]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[39]  Mohamed-Jalal Fadili,et al.  Multi-Scale Variance Stabilizing Transform for Multi-Dimensional Poisson Count Image Denoising , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[40]  Patrick Bouthemy,et al.  An adaptive statistical method for 4D-fluorescence image sequence denoising with spatio-temporal discontinuities preserving , 2006 .

[41]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[42]  J. Fadili,et al.  Fast Poisson Noise Removal by Biorthogonal Haar Domain Hypothesis Testing , 2006, math/0608631.

[43]  Kostadin Dabov,et al.  MOVING-WINDOW VARYING SIZE 3D TRANSFORM-BASED VIDEO DENOISING , 2006 .

[44]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[45]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[46]  Suyash P. Awate,et al.  Unsupervised, information-theoretic, adaptive image filtering for image restoration , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[48]  Charles Kervrann,et al.  Local Adaptivity to Variable Smoothness for Exemplar-Based Image Regularization and Representation , 2008, International Journal of Computer Vision.

[49]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[50]  Guy Gilboa,et al.  Nonlocal Linear Image Regularization and Supervised Segmentation , 2007, Multiscale Model. Simul..

[51]  Nikos Paragios,et al.  Variable Bandwidth Image Denoising Using Image-based Noise Models , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[53]  V. Spokoiny,et al.  Spatial aggregation of local likelihood estimates with applications to classification , 2007, 0712.0939.

[54]  Patrick Bouthemy,et al.  Space-Time Adaptation for Patch-Based Image Sequence Restoration , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Mohamed-Jalal Fadili,et al.  Multiscale Variance-Stabilizing Transform for Mixed-Poisson-Gaussian Processes and its Applications in Bioimaging , 2007, 2007 IEEE International Conference on Image Processing.

[56]  Pierrick Coupé,et al.  Bayesian Non-local Means Filter, Image Redundancy and Adaptive Dictionaries for Noise Removal , 2007, SSVM.

[57]  Patrick Bouthemy,et al.  Non-parametric regression for patch-based fluorescence microscopy image sequence denoising , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[58]  Ioannis A. Kakadiaris,et al.  Denoising for 3-D Photon-Limited Imaging Data Using Nonseparable Filterbanks , 2008, IEEE Transactions on Image Processing.

[59]  Mohamed-Jalal Fadili,et al.  Wavelets, Ridgelets, and Curvelets for Poisson Noise Removal , 2008, IEEE Transactions on Image Processing.

[60]  D. Tschumperlé,et al.  IMAGE DENOISING AND REGISTRATION BY PDE'S ON THE SPACE OF PATCHES , 2008 .

[61]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[62]  Daniel Cremers,et al.  Efficient Nonlocal Means for Denoising of Textural Patterns , 2008, IEEE Transactions on Image Processing.

[63]  Thierry Blu,et al.  Multiframe sure-let denoising of timelapse fluorescence microscopy images , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[64]  Michael Unser,et al.  Deconvolution of 3D fluorescence micrographs with automatic risk minimization , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[65]  Michael Elad,et al.  Learning Multiscale Sparse Representations for Image and Video Restoration , 2007, Multiscale Model. Simul..

[66]  Jaakko Astola,et al.  From Local Kernel to Nonlocal Multiple-Model Image Denoising , 2009, International Journal of Computer Vision.

[67]  Thierry Blu,et al.  Fast Haar-wavelet denoising of multidimensional fluorescence microscopy data , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[68]  S. Hell Far-field optical nanoscopy , 2010 .