Background estimation in nonlinear image restoration

One of the essential ways in which nonlinear image restoration algorithms differ from linear, convolution-type image restoration filters is their capability to restrict the restoration result to nonnegative intensities. The iterative constrained Tikhonov–Miller (ICTM) algorithm, for example, incorporates the nonnegativity constraint by clipping all negative values to zero after each iteration. This constraint will be effective only when the restored intensities have near-zero values. Therefore the background estimation will have an influence on the effectiveness of the nonnegativity constraint of these algorithms. We investigated quantitatively the dependency of the performance of the ICTM, Carrington, and Richardson–Lucy algorithms on the estimation of the background and compared it with the performance of the linear Tikhonov–Miller restoration filter. We found that the performance depends critically on the background estimation: An underestimation of the background will make the nonnegativity constraint ineffective, which results in a performance that does not differ much from the Tikhonov–Miller filter performance. A (small) overestimation, however, degrades the performance dramatically, since it results in a clipping of object intensities. We propose a novel general method to estimate the background based on the dependency of nonlinear restoration algorithms on the background, and we demonstrate its applicability on real confocal images.

[1]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[2]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[3]  H. M. Voort,et al.  Restoration of confocal images for quantitative image analysis , 1995 .

[4]  Wolfgang Osten,et al.  Introduction to Inverse Problems in Imaging , 1999 .

[5]  W. A. Carrington Image restoration in 3-D microscopy with limited data , 1990, Photonics West - Lasers and Applications in Science and Engineering.

[6]  P. J. Verveer,et al.  Computational and optical methods for improving resolution and signal quality in fluorescence microscopy , 1998 .

[7]  L. Shepp,et al.  A Statistical Model for Positron Emission Tomography , 1985 .

[8]  Piet W. Verbeek,et al.  Low-level image processing by max–min filters , 1988 .

[9]  Guy Demoment,et al.  Image reconstruction and restoration: overview of common estimation structures and problems , 1989, IEEE Trans. Acoust. Speech Signal Process..

[10]  Donald L. Snyder,et al.  Random Point Processes in Time and Space , 1991 .

[11]  Timothy J. Holmes Maximum-likelihood image restoration adapted for noncoherent optical imaging , 1988 .

[12]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[13]  Stanley J. Reeves,et al.  Generalized cross‐validation as a stopping rule for the Richardson‐Lucy algorithm , 1995, Int. J. Imaging Syst. Technol..

[14]  G. Wied,et al.  Automated cell identification and cell sorting , 1970 .

[15]  B. R. Hunt,et al.  Digital Image Restoration , 1977 .

[16]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[17]  I. Heertje,et al.  Liquid Crystalline Phases in the Structuring of Food Products , 1998 .

[18]  William H. Press,et al.  Numerical recipes in C , 2002 .

[19]  J A Conchello,et al.  Superresolution and convergence properties of the expectation-maximization algorithm for maximum-likelihood deconvolution of incoherent images. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  J. Pawley,et al.  Handbook of Biological Confocal Microscopy , 1990, Springer US.

[21]  Florin Popentiu,et al.  Iterative identification and restoration of images , 1993, Comput. Graph..

[22]  Lucas J. van Vliet,et al.  Application of image restoration methods for confocal fluorescence microscopy , 1997, Photonics West - Biomedical Optics.

[23]  R. Gerchberg Super-resolution through Error Energy Reduction , 1974 .

[24]  F S Fay,et al.  Superresolution three-dimensional images of fluorescence in cells with minimal light exposure. , 1995, Science.

[25]  Thomas M. Jovin,et al.  Acceleration of the ICTM image restoration algorithm , 1997 .

[26]  Jose-Angel Conchello,et al.  Fast regularization technique for expectation maximization algorithm for optical sectioning microscopy , 1996, Electronic Imaging.

[27]  Tony Wilson,et al.  Three dimensional image reconstruction in conventional and confocal microscopy , 1993 .

[28]  William H. Press,et al.  Numerical recipes , 1990 .

[29]  Mario Bertero,et al.  Introduction to Inverse Problems in Imaging , 1998 .

[30]  R. White,et al.  Image recovery from data acquired with a charge-coupled-device camera. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[31]  G. M. P. VAN KEMPEN,et al.  A quantitative comparison of image restoration methods for confocal microscopy , 1997 .

[32]  Lucas J. van Vliet,et al.  The application of a Local Dimensionality Estimator to the analysis of 3-D microscopic network structures , 1999 .

[33]  P. Verveer,et al.  A comparison of image restoration approaches applied to three‐dimensional confocal and wide‐field fluorescence microscopy , 1999, Journal of microscopy.

[34]  Geert M. P. van Kempen,et al.  Image Restoration in Fluorescence Microscopy , 1999 .

[35]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[36]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.