Digital image inpainting and microscopy imaging

A considerable amount of image processing techniques known as inpainting techniques have been recently developed aiming to provide solutions for filling in missing or damaged regions in a digital image. Typical such techniques reconstruct a defined area by using information from its neighborhood, for example, by completing inside the missing region the isophote lines arriving at its boundaries. In this article, we show that inpainting techniques have considerable potential usefulness in microscopy imaging, even though experimenting and using them in this domain has been almost entirely neglected up until now. In this purpose, we experiment the “curvature‐preserving” partial differential equations as a solution to inpainting regions in images collected by several optical and scanning probe microscopy techniques. The results achieved are presented along with a discussion on typical problematic scenarios of microscopy imaging for which this type of techniques can provide a viable solution. Microsc. Res. Tech., 2011. © 2011 Wiley Periodicals, Inc.

[1]  Tom Vercauteren,et al.  Image registration and mosaicing for dynamic In vivo fibered confocal microscopy : Image Registration and Mosaicing for Dynamic In Vivo Fibered Confocal Microscopy. (Recalage et mosaïques d'images pour la microscopie confocale fibrée dynamique in vivo) , 2008 .

[2]  David Tschumperlé,et al.  Fast Anisotropic Smoothing of Multi-Valued Images using Curvature-Preserving PDE's , 2006, International Journal of Computer Vision.

[3]  Gerber,et al.  Atomic Force Microscope , 2020, Definitions.

[4]  Manuel Menezes de Oliveira Neto,et al.  Fast Digital Image Inpainting , 2001, VIIP.

[5]  P. Selvin.  Fluorescence resonance energy transfer. , 1995, Methods in enzymology.

[6]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[7]  C. Gerber,et al.  Surface Studies by Scanning Tunneling Microscopy , 1982 .

[8]  Dinu Coltuc,et al.  Automated compensation of light attenuation in confocal microscopy by exact histogram specification , 2010, Microscopy research and technique.

[9]  Vahid Sandoghdar,et al.  Reflection scanning near-field optical microscopy with uncoated fiber tips: How good is the resolution really? , 1997 .

[10]  Brian Cabral,et al.  Imaging vector fields using line integral convolution , 1993, SIGGRAPH.

[11]  Stéphane Lafon,et al.  Diffusion maps , 2006 .

[12]  Lukas Novotny,et al.  Facts and artifacts in near-field optical microscopy , 1997 .

[13]  M Robles,et al.  Fetal MRI Slice Reconstruction using 3D inpainting , 2009, NeuroImage.

[14]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  J. Conchello,et al.  Artefacts in restored images due to intensity loss in three‐dimensional fluorescence microscopy , 2001, Journal of microscopy.

[16]  F. Keilmann,et al.  Pure optical contrast in scattering‐type scanning near‐field microscopy , 2001, Journal of microscopy.

[17]  Tony F. Chan,et al.  Non-texture inpainting by curvature-driven diffusions (CDD) , 2001 .

[18]  Guillermo Sapiro,et al.  Structure and texture filling-in of missing image blocks in wireless transmission and compression applications , 2003, IEEE Trans. Image Process..

[19]  M. Black,et al.  Artefacts in immunofluorescence microscopy: a potential source of diagnostic confusion , 1992 .

[20]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[21]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Alexandru Telea,et al.  An Image Inpainting Technique Based on the Fast Marching Method , 2004, J. Graphics, GPU, & Game Tools.

[23]  Stanley Osher,et al.  Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing , 2003, J. Sci. Comput..

[24]  Michael Unser,et al.  User‐friendly semiautomated assembly of accurate image mosaics in microscopy , 2007, Microscopy research and technique.

[25]  Michael W. Davidson,et al.  Differential Interference Contrast Microscopy and Modulation Contrast Microscopy , 2012 .

[26]  Michael Riffle,et al.  The Yeast Resource Center Public Image Repository: A large database of fluorescence microscopy images , 2010, BMC Bioinformatics.

[27]  Feng He,et al.  Use of Autostitch for automatic stitching of microscope images. , 2007, Micron.

[28]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1992 .

[29]  K Brauchli,et al.  Telemicroscopy by the Internet revisited , 2002, The Journal of pathology.

[30]  Célia A. Zorzo Barcelos,et al.  Geodesic path based digital inpainting , 2007, Appl. Math. Comput..

[31]  Ching-Tang Hsieh,et al.  Progressive Image Inpainting Based on Wavelet Transform , 2005, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[32]  Guillermo Sapiro,et al.  On geometric variational models for inpainting surface holes , 2008, Comput. Vis. Image Underst..

[33]  J. Bohr,et al.  Contrast artifacts in tapping tip atomic force microscopy , 1998 .

[34]  C. Chui.  An MRA approach to surface completion and image inpainting , 2009 .

[35]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[36]  Pengcheng Shi,et al.  Physics Based Contrast Marking and Inpainting Based Local Texture Comparison for Clustered Microcalcification Detection , 2004, MICCAI.

[37]  M. Capek,et al.  Methods for compensation of the light attenuation with depth of images captured by a confocal microscope , 2006, Microscopy research and technique.

[38]  Gilberte Émile-Mâle.  The restorer's handbook of easel painting , 1976 .

[39]  S. Stanciu,et al.  Near field investigation based on a novel apertureless near field optical microscope , 2009, 2009 3rd ICTON Mediterranean Winter Conference (ICTON-MW).