Non-parametric regression for patch-based fluorescence microscopy image sequence denoising

We present a non-parametric regression method for denoising fluorescence video-microscopy volume sequences. The designed method aims at using the 3D+t information in order to restore acquired data contaminated by Poisson and Gaussian noise. We propose to use a variance stabilization transform to deal with the combination of Poisson and Gaussian noise. Consequently, we further propose an adaptive patch-based framework able to preserve space-time discontinuities and reduce significantly noise level using the 3D+t space-time context. This approach lead to an algorithm whose parameters are calibrated and then ready for intensive use. The performance of the proposed method are then demonstrated on both synthetic and real image sequences using quantitative as well as qualitative criteria.

[1]  Guy Gilboa,et al.  Nonlocal Linear Image Regularization and Supervised Segmentation , 2007, Multiscale Model. Simul..

[2]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[3]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[4]  Giovanni Motta,et al.  The DUDE framework for continuous tone image denoising , 2005, IEEE International Conference on Image Processing 2005.

[5]  Jean-Michel Morel,et al.  Denoising image sequences does not require motion estimation , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[6]  G. Nason,et al.  A Haar-Fisz Algorithm for Poisson Intensity Estimation , 2004 .

[7]  F. J. Anscombe,et al.  THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATA , 1948 .

[8]  Charles Kervrann,et al.  Optimal Spatial Adaptation for Patch-Based Image Denoising , 2006, IEEE Transactions on Image Processing.

[9]  David Zhang,et al.  Image information restoration based on long-range correlation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[10]  J. Boulanger,et al.  Local adaptivity to variable smoothness for exemplar-based image denoising and representation , 2005 .

[11]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[12]  E. Mammen,et al.  Optimal spatial adaptation to inhomogeneous smoothness: an approach based on kernel estimates with variable bandwidth selectors , 1997 .

[13]  Eli Shechtman,et al.  Space-time video completion , 2004, CVPR 2004.

[14]  Kostadin Dabov,et al.  MOVING-WINDOW VARYING SIZE 3D TRANSFORM-BASED VIDEO DENOISING , 2006 .

[15]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[16]  Stanley Osher,et al.  Deblurring and Denoising of Images by Nonlocal Functionals , 2005, Multiscale Model. Simul..

[17]  Fionn Murtagh,et al.  Image restoration with noise suppression using a multiresolution support. , 1995 .

[18]  Ljubisa Stankovic,et al.  Performance analysis of the adaptive algorithm for bias-to-variance tradeoff , 2004, IEEE Transactions on Signal Processing.

[19]  Daniel Cremers,et al.  Iterated Nonlocal Means for Texture Restoration , 2007, SSVM.

[20]  Thierry Blu,et al.  Multiframe sure-let denoising of timelapse fluorescence microscopy images , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[21]  Patrick Pérez,et al.  Spatio-temporal Wiener filtering of image sequences using a parametric motion model , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[22]  Aggelos K. Katsaggelos,et al.  Noise reduction filters for dynamic image sequences: a review , 1995, Proc. IEEE.

[23]  Fionn Murtagh,et al.  Image Processing and Data Analysis - The Multiscale Approach , 1998 .

[24]  D. Agard.  Optical sectioning microscopy: cellular architecture in three dimensions. , 1984, Annual review of biophysics and bioengineering.

[25]  Nasir M. Rajpoot,et al.  Adaptive wavelet restoration of noisy video sequences , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[26]  Robert D. Nowak,et al.  Platelets: a multiscale approach for recovering edges and surfaces in photon-limited medical imaging , 2003, IEEE Transactions on Medical Imaging.

[27]  Narendra Ahuja,et al.  Video denoising by combining Kalman and Wiener estimates , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[28]  Nikos Paragios,et al.  Variable Bandwidth Image Denoising Using Image-based Noise Models , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Karen O. Egiazarian,et al.  Practical Poissonian-Gaussian Noise Modeling and Fitting for Single-Image Raw-Data , 2008, IEEE Transactions on Image Processing.

[30]  Fionn Murtagh,et al.  Automatic Noise Estimation from the Multiresolution Support , 1998 .

[31]  Patrick Bouthemy,et al.  An adaptive statistical method for 4D-fluorescence image sequence denoising with spatio-temporal discontinuities preserving , 2006 .

[32]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[33]  B. Jähne,et al.  Spatiotemporal anisotropic diffusion filtering to improve signal-to-noise ratios and object restoration in fluorescence microscopic image sequences. , 2003, Journal of biomedical optics.

[34]  Suk Ho Lee,et al.  Spatio-temporal video filtering algorithm based on 3-D anisotropic diffusion equation , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[35]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[36]  Mohamed-Jalal Fadili,et al.  Multi-Scale Variance Stabilizing Transform for Multi-Dimensional Poisson Count Image Denoising , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[37]  T. Gasser,et al.  Residual variance and residual pattern in nonlinear regression , 1986 .

[38]  A. Tsybakov,et al.  Introduction à l'estimation non-paramétrique , 2003 .

[39]  Patrick Bouthemy,et al.  Space-Time Adaptation for Patch-Based Image Sequence Restoration , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Michael Elad,et al.  Learning Multiscale Sparse Representations for Image and Video Restoration , 2007, Multiscale Model. Simul..

[41]  Jean-Michel Morel,et al.  Nonlocal Image and Movie Denoising , 2008, International Journal of Computer Vision.

[42]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[43]  Jong-Sen Lee,et al.  Speckle analysis and smoothing of synthetic aperture radar images , 1981 .

[44]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[45]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Hye-Yeon Cheong,et al.  Adaptive spatio-temporal filtering for video denoising , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[47]  A. Kuznetsov,et al.  FRET-based voltage probes for confocal imaging: membrane potential oscillations throughout pancreatic islets. , 2005, American journal of physiology. Cell physiology.

[48]  Guillermo Sapiro,et al.  Fast image and video denoising via nonlocal means of similar neighborhoods , 2005, IEEE Signal Processing Letters.

[49]  Suyash P. Awate,et al.  Unsupervised, information-theoretic, adaptive image filtering for image restoration , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  S. Hell.  Far-Field Optical Nanoscopy , 2007, Science.

[51]  Aggelos K. Katsaggelos,et al.  Image sequence filtering in quantum-limited noise with applications to low-dose fluoroscopy , 1993, IEEE Trans. Medical Imaging.

[52]  Jean-Baptiste Sibarita,et al.  Ultra-fast 4D microscopy and high throughput distributed deconvolution , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[53]  Charles Kervrann,et al.  An adaptive window approach for Poisson noise reduction and structure preserving in confocal microscopy , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[54]  Vladimir Zlokolica,et al.  Motion- and detail-adaptive denoising of video , 2004, IS&T/SPIE Electronic Imaging.