Intensity-based matching and registration for 3D correlative microscopy with large discrepancies

Correlative microscopy, especially light and electron microscopy (CLEM), enables the study of cells and subcellular elements in complementary ways, provided a reliable registration between images is efficiently achievable. We propose a general automatic registration method. Due to large discrepancies in appearance, field-of-view, resolution and position, a pre-alignment stage is required before any 3D fine registration stage. We define an intensity-based method for both stages, which leverages a common representation of the two involved image modalities. We report experimental results on different real datasets of 3D correlative microscopy, demonstrating time efficiency and overlay accuracy.

[1]  Sébastien Barré,et al.  Correlative Imaging of the Murine Hind Limb Vasculature and Muscle Tissue by MicroCT and Light Microscopy , 2017, Scientific Reports.

[2]  Patrick Bouthemy,et al.  Adaptive Spot Detection With Optimal Scale Selection in Fluorescence Microscopy Images , 2015, IEEE Transactions on Image Processing.

[3]  Øyvind Halaas,et al.  Seeing a Mycobacterium-Infected Cell in Nanoscale 3D: Correlative Imaging by Light Microscopy and FIB/SEM Tomography , 2015, PloS one.

[4]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[5]  L. Looger,et al.  Diverse protocols for correlative super-resolution fluorescence imaging and electron microscopy of chemically fixed samples , 2017, Nature Protocols.

[6]  B. Ruthensteiner,et al.  A correlative approach for combining microCT, light and transmission electron microscopy in a single 3D scenario , 2013, Frontiers in Zoology.

[7]  Wolfgang Baumeister,et al.  Coordinate transformation based cryo-correlative methods for electron tomography and focused ion beam milling. , 2014, Ultramicroscopy.

[8]  Sriram Subramaniam,et al.  Correlative 3D imaging of whole mammalian cells with light and electron microscopy. , 2011, Journal of structural biology.

[9]  Christopher J. Peddie,et al.  Correlative and integrated light and electron microscopy of in-resin GFP fluorescence, used to localise diacylglycerol in mammalian cells , 2014, Ultramicroscopy.

[10]  Alberto Diaspro,et al.  3D HDO-CLEM: cellular compartment analysis by correlative light-electron microscopy on cryosection. , 2012, Methods in cell biology.

[11]  Jean Salamero,et al.  eC-CLEM: flexible multidimensional registration software for correlative microscopies , 2017, Nature Methods.

[12]  Patrick Bouthemy,et al.  A common image representation and a patch-based search for correlative light-electron-microscopy (CLEM) registration , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[13]  Callen T Wallace,et al.  Correlative Fluorescence and Electron Microscopy in 3D—Scanning Electron Microscope Perspective , 2017, Current protocols in cytometry.

[14]  Christopher J. Peddie,et al.  3D correlative light and electron microscopy of cultured cells using serial blockface scanning electron microscopy , 2017, Journal of Cell Science.

[15]  Oksam Chae,et al.  Facial expression recognition using Local Directional Pattern (LDP) , 2010, 2010 IEEE International Conference on Image Processing.

[16]  J. Gray,et al.  A fully integrated, three-dimensional fluorescence to electron microscopy correlative workflow. , 2017, Methods in cell biology.

[17]  D. Bohórquez,et al.  Correlative Confocal and 3D Electron Microscopy of a Specific Sensory Cell , 2015, Journal of visualized experiments : JoVE.

[18]  Pascal Fua,et al.  Correlative in vivo 2-photon imaging and focused ion beam scanning electron microscopy: 3D analysis of neuronal ultrastructure. , 2014, Methods in cell biology.

[19]  Yannick Schwab,et al.  Find your way with X-Ray: Using microCT to correlate in vivo imaging with 3D electron microscopy. , 2017, Methods in cell biology.