Artificial Defocus for Displaying Markers in Microscopy Z-Stacks

As microscopes have a very shallow depth of field, Z-stacks (i.e. sets of images shot at different focal planes) are often acquired to fully capture a thick sample. Such stacks are viewed by users by navigating them through the mouse wheel. We propose a new technique of visualizing 3D point, line or area markers in such focus stacks, by displaying them with a depth-dependent defocus, simulating the microscope's optics; this leverages on the microscopists' ability to continuously twiddle focus, while implicitly performing a shape-from-focus reconstruction of the 3D structure of the sample. User studies confirm that the approach is effective, and can complement more traditional techniques such as color-based cues. We provide two implementations, one of which computes defocus in real time on the GPU, and examples of their application.

[1]  E. Myers,et al.  A 3D Digital Atlas of C. elegans and Its Application To Single-Cell Analyses , 2009, Nature Methods.

[2]  David W. Murray,et al.  Simulating Low-Cost Cameras for Augmented Reality Compositing , 2010, IEEE Transactions on Visualization and Computer Graphics.

[3]  Tony Pan,et al.  Volume Rendering Phenotype Differences in Mouse Placenta Microscopy Data , 2007, Computing in Science & Engineering.

[4]  T J Holmes,et al.  Blind deconvolution of 3D transmitted light brightfield micrographs , 2000, Journal of microscopy.

[5]  Joel H. Saltz,et al.  Ieee Transactions on Visualization and Computer Graphics Reconstruction of Cellular Biological Structures from Optical Microscopy Data , 2022 .

[6]  Stephen T. C. Wong,et al.  Classification and Uncertainty Visualization of Dendritic Spines from Optical Microscopy Imaging , 2008, Comput. Graph. Forum.

[7]  Sungkil Lee,et al.  Real-Time Depth-of-Field Rendering Using Anisotropically Filtered Mipmap Interpolation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[8]  J. Conchello,et al.  Three-dimensional imaging by deconvolution microscopy. , 1999, Methods.

[9]  Sheng Liu,et al.  A Novel Prototype for an Optical See-Through Head-Mounted Display with Addressable Focus Cues , 2010, IEEE Transactions on Visualization and Computer Graphics.

[10]  Qiqi Wang,et al.  GPU-based visualization techniques for 3D microscopic imaging data , 2007, Electronic Imaging.

[11]  Shawn Mikula,et al.  Interactive visualization of multiresolution image stacks in 3D , 2007, NeuroImage.

[12]  J R Kremer,et al.  Computer visualization of three-dimensional image data using IMOD. , 1996, Journal of structural biology.

[13]  Dimitri Van De Ville,et al.  Joint texture and topography estimation for extended depth of field in brightfield microscopy , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[14]  Luca Gianaroli,et al.  Embryo morphology and development are dependent on the chromosomal complement. , 2007, Fertility and sterility.

[15]  Luca Maria Gambardella,et al.  3D Localization of Pronuclei of Human Zygotes Using Textures from Multiple Focal Planes , 2010, MICCAI.

[16]  R. Kurzawa,et al.  Methods of embryo scoring in in vitro fertilization. , 2004, Reproductive biology.

[17]  Joel H. Saltz,et al.  The virtual microscope , 2003, IEEE Transactions on Information Technology in Biomedicine.

[18]  Victoria J Allan,et al.  Light Microscopy Techniques for Live Cell Imaging , 2003, Science.

[19]  Arie E. Kaufman,et al.  Volume visualization in cell biology , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[20]  Alessandro Giusti,et al.  Localization of Pronuclei of Human Zygotes using Texture Features from Multiple Focal Planes , 2010 .

[21]  L. Gianaroli,et al.  Oocyte euploidy, pronuclear zygote morphology and embryo chromosomal complement. , 2007, Human reproduction.

[22]  Anne E Carpenter,et al.  Visualization of image data from cells to organisms , 2010, Nature Methods.

[23]  Naokazu Yokoya,et al.  Augmented reality based on estimation of defocusing and motion blurring from captured images , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[24]  Markus H. Gross,et al.  A Framework for Holographic Scene Representation and Image Synthesis , 2006, IEEE Transactions on Visualization and Computer Graphics.

[25]  Paul Mills,et al.  Virtual Microscopy with Extended Depth of Field , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[26]  Markus H. Gross,et al.  A Framework for Holographic Scene Representation and Image Synthesis , 2007, IEEE Trans. Vis. Comput. Graph..

[27]  Stephan Saalfeld,et al.  CATMAID: collaborative annotation toolkit for massive amounts of image data , 2009, Bioinform..

[28]  Luca Maria Gambardella,et al.  Blastomere segmentation and 3D morphology measurements of early embryos from Hoffman Modulation Contrast image stacks , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[29]  M. Langeron,et al.  Handbook on Microscopy. , 1983 .

[30]  Georgios Sakas,et al.  Visualization of Laser Confocal Microscopy Datasets , 1996, IEEE Visualization.

[31]  G. Sakas,et al.  Case study: visualization of laser confocal microscopy datasets , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[32]  Russell M. Taylor,et al.  FluoroSim: A Visual Problem-Solving Environment for Fluorescence Microscopy , 2008, VCBM.

[33]  Qiang Wu,et al.  Microscope Image Processing , 2010 .