Image-Based Artefact Removal in Laser Scanning Microscopy

Recent developments in laser scanning microscopy have greatly extended its applicability in cancer imaging beyond the visualization of complex biology, and opened up the possibility of quantitative analysis of inherently dynamic biological processes. However, the physics of image acquisition intrinsically means that image quality is subject to a tradeoff between a number of imaging parameters, including resolution, signal-to-noise ratio, and acquisition speed. We address the problem of geometric distortion, in particular, jaggedness artefacts that are caused by the variable motion of the microscope laser, by using a combination of image processing techniques. Image restoration methods have already shown great potential for post-acquisition image analysis. The performance of our proposed image restoration technique was first quantitatively evaluated using phantom data with different textures, and then qualitatively assessed using in vivo biological imaging data. In both cases, the presented method, comprising a combination of image registration and filtering, is demonstrated to have substantial improvement over state-of-the-art microscopy acquisition methods.

[1]  Paul Salama,et al.  IMART software for correction of motion artifacts in images collected in intravital microscopy , 2014, Intravital.

[2]  Ralph Weissleder,et al.  Intravital Imaging , 2011, Cell.

[3]  S. Charpak,et al.  Two-photon imaging of capillary blood flow in olfactory bulb glomeruli. , 2009, Methods in molecular biology.

[4]  B. MacVicar,et al.  Calcium transients in astrocyte endfeet cause cerebrovascular constrictions , 2004, Nature.

[5]  D. Siemann,et al.  The unique characteristics of tumor vasculature and preclinical evidence for its selective disruption by Tumor-Vascular Disrupting Agents. , 2011, Cancer treatment reviews.

[6]  Julia A. Schnabel,et al.  Segmentation of Vasculature From Fluorescently Labeled Endothelial Cells in Multi-Photon Microscopy Images , 2019, IEEE Transactions on Medical Imaging.

[7]  V. Zaleckas,et al.  Laser scanning microscopy , 1982, Proceedings of the IEEE.

[8]  J Boutet de Monvel,et al.  Image restoration for confocal microscopy: improving the limits of deconvolution, with application to the visualization of the mammalian hearing organ. , 2001, Biophysical journal.

[9]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[10]  A. Nehorai,et al.  Deconvolution methods for 3-D fluorescence microscopy images , 2006, IEEE Signal Processing Magazine.

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  E. Pnevmatikakis,et al.  NoRMCorre: An online algorithm for piecewise rigid motion correction of calcium imaging data , 2017, Journal of Neuroscience Methods.

[13]  Ruth J. Muschel,et al.  Motion Correction of Intravital Microscopy of Preclinical Lung Tumour Imaging Using Multichannel Structural Image Descriptor , 2014, WBIR.

[14]  Elizabeth M C Hillman,et al.  Optical brain imaging in vivo: techniques and applications from animal to man. , 2007, Journal of biomedical optics.

[15]  Ralph Weissleder,et al.  Automated motion artifact removal for intravital microscopy, without a priori information , 2014, Scientific Reports.

[16]  Nicholas Ayache,et al.  Robust mosaicing with correction of motion distortions and tissue deformations for in vivo fibered microscopy , 2006, Medical Image Anal..

[17]  Henry Pinkard,et al.  Spatiotemporal Rank Filtering Improves Image Quality Compared to Frame Averaging in 2-Photon Laser Scanning Microscopy , 2016, PloS one.

[18]  Edward J. Delp,et al.  Digital correction of motion artefacts in microscopy image sequences collected from living animals using rigid and nonrigid registration , 2012, Journal of microscopy.

[19]  David W Piston,et al.  A Motion Correction Framework for Time Series Sequences in Microscopy Images , 2013, Microscopy and Microanalysis.

[20]  M. Berridge,et al.  The versatility and universality of calcium signalling , 2000, Nature Reviews Molecular Cell Biology.

[21]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  M. Bootman,et al.  An update on nuclear calcium signalling , 2009, Journal of Cell Science.

[23]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).