Increased depth of field and stereo pairs of fluorescence micrographs via inverse filtering and maximum‐likelihood estimation

Image processing methods are presented for effectively increasing the depth of field and for generating stereo pairs of fluorescence micrographs from a conventional optical microscope. In developing these methods the slice theorem of computed tomography is used. In this way the image reconstruction problem is reduced to one of processing only two‐dimensional arrays rather than three‐dimensional arrays and the classical difficult problem of restoring missing Fourier components within the missing cone region is circumvented. Two different approaches to such processing are presented. One approach is based on inverse filtering. Another approach is based on previous development of iterative image restoration algorithms for quantum‐limited incoherent imagery, founded on maximum‐likelihood estimation. Limited experimentation with real micrographs shows that both approaches work well. Some preliminary comparisons are made between the different variations of the methods tested, which point out the advantages and present limitations. Both methods can be implemented on IBM‐AT‐compatible computers with relatively fast execution times. Advantages that these methods have over confocal microscopy are (i) the optical and computing equipment required is less expensive, and (ii) a conventional microscope when set up properly can have much better light sensitivity than a confocal microscope.

[1]  Donald L. Snyder,et al.  Image Reconstruction from List-Mode Data in an Emission Tomography System Having Time-of-Flight Measurements , 1983, IEEE Transactions on Nuclear Science.

[2]  J W Sedat,et al.  Light microscope based analysis of three‐dimensional structure: Applications to the study of Drosophila salivary gland nuclei. I. Data collection and analysis , 1985, Journal of microscopy.

[3]  R J Pieper,et al.  Image processing for extended depth of field. , 1983, Applied optics.

[4]  Donald B. Rubin,et al.  Max-imum Likelihood from Incomplete Data , 1972 .

[5]  D. Agard,et al.  Determination of three-dimensional imaging properties of a light microscope system. Partial confocal behavior in epifluorescence microscopy. , 1990, Biophysical journal.

[6]  D. Agard,et al.  The use of a charge-coupled device for quantitative optical microscopy of biological structures. , 1987, Science.

[7]  N. Streibl Three-dimensional imaging by a microscope , 1985 .

[8]  J. Aggarwal,et al.  Improvement in the resolution of three‐dimensional data sets collected using optical serial sectioning , 1989 .

[9]  N. Streibl Depth Transfer by an Imaging System , 1984 .

[10]  Y Ichioka,et al.  Digital composition of images with increased depth of focus considering depth information. , 1985, Applied optics.

[11]  D. Agard Optical sectioning microscopy: cellular architecture in three dimensions. , 1984, Annual review of biophysics and bioengineering.

[12]  J Bille,et al.  Reconstructing 3-D light-microscopic images by digital image processing. , 1985, Applied optics.

[13]  B. Frieden,et al.  Optical Transfer of the Three-Dimensional Object*† , 1967 .

[14]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[15]  Jake K. Aggarwal,et al.  Digital reconstruction of three-dimensional serially sectioned optical images , 1988, IEEE Trans. Acoust. Speech Signal Process..

[16]  T. Holmes,et al.  Acceleration of Maximum-Likelihood Image-Restoration for Fluorescence Microscopy and Other Noncoherent Imagery , 1991, Quantum Limited Imaging and Information Processing.

[17]  K. Lange Convergence of EM image reconstruction algorithms with Gibbs smoothing. , 1990, IEEE transactions on medical imaging.

[18]  L. Shepp,et al.  Maximum Likelihood Reconstruction for Emission Tomography , 1983, IEEE Transactions on Medical Imaging.

[19]  Yi-Hwa Liu,et al.  Simulation Tests Of Restoring Truncated Fluorescence Micrographs , 1989, Optics & Photonics.

[20]  David A. Agard,et al.  Three-Dimensional Microscopy: Image Processing For High Resolution Subcellular Imaging , 1989, Optics & Photonics.

[21]  F S Fay,et al.  Three‐dimensional molecular distribution in single cells analysed using the digital imaging microscope , 1989, Journal of microscopy.

[22]  T J Holmes,et al.  Richardson-Lucy/maximum likelihood image restoration algorithm for fluorescence microscopy: further testing. , 1989, Applied optics.

[23]  L. J. Thomas,et al.  A Matheematical Model for Positron-Emission Tomography Systems Having Time-of-Flight Measurements , 1981, IEEE Transactions on Nuclear Science.

[24]  M.I. Miller,et al.  The role of likelihood and entropy in incomplete-data problems: Applications to estimating point-process intensities and toeplitz constrained covariances , 1987, Proceedings of the IEEE.

[25]  L. J. Thomas,et al.  Noise and Edge Artifacts in Maximum-Likelihood Reconstructions for Emission Tomography , 1987, IEEE Transactions on Medical Imaging.

[26]  L. Shepp,et al.  A Statistical Model for Positron Emission Tomography , 1985 .

[27]  T. Holmes Expectation-maximization restoration of band-limited, truncated point-process intensities with application in microscopy , 1989 .

[28]  Y. Ichioka,et al.  Digitized optical microscopy with extended depth of field. , 1989, Applied optics.

[29]  Timothy J. Holmes Maximum-likelihood image restoration adapted for noncoherent optical imaging , 1988 .

[30]  Richard M. Leahy,et al.  Fast MLE for SPECT using an intermediate polar representation and a stopping criterion , 1988 .