Multi-Spectral Widefield Microscopy of the Beating Heart Through Post-Acquisition Synchronization and Unmixing

Multi-spectral imaging allows distinguishing biological structures. For cardiac microscopy, available devices are either too slow or require illumination intensities that are detrimental to the sample. We present a method for spectral super-resolution imaging of samples whose motion is quasi-periodic by sequentially acquiring movies in wavelength ranges with filters of overlapping bands. Following an initial calibration procedure, we synchronize and unmix the movies to produce multi-spectral sequences. We characterized our approach to retrieve the transmittance of a colored microscopic target whose motion we controlled, observing measurements within of 10% that of a reference spectrometer. We further illustrate our approach to observe the beating embryonic zebrafish heart, demonstrating new possibilities for studying its development.

[1]  Michael Liebling,et al.  Nonuniform temporal alignment of slice sequences for four-dimensional imaging of cyclically deforming embryonic structures , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[2]  lexander,et al.  THE GENERALIZED SIMPLEX METHOD FOR MINIMIZING A LINEAR FORM UNDER LINEAR INEQUALITY RESTRAINTS , 2012 .

[3]  Moshe Ben-Ezra,et al.  Multi-Spectral Imaging by Optimized Wide Band Illumination , 2008, International Journal of Computer Vision.

[4]  Colin Studholme,et al.  Normalized entropy measure for multimodality image alignment , 1998, Medical Imaging.

[5]  Michael S. Brown,et al.  Do It Yourself Hyperspectral Imaging with Everyday Digital Cameras , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Til Aach,et al.  High Dynamic Range Microscopy for Cytopathological Cancer Diagnosis , 2009, IEEE Journal of Selected Topics in Signal Processing.

[7]  Shree K. Nayar,et al.  Multispectral Imaging Using Multiplexed Illumination , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[8]  Stephan Preibisch,et al.  OpenSPIM: an open-access light-sheet microscopy platform , 2013, Nature Methods.

[9]  Lawrence Carin,et al.  Spectral-temporal compressive imaging. , 2015, Optics letters.

[10]  Joyce Farrell,et al.  Multispectral imaging of tissue ablation , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[11]  Konrad Schindler,et al.  Learned Spectral Super-Resolution , 2017, ArXiv.

[12]  Hairong Qi,et al.  Unsupervised Sparse Dirichlet-Net for Hyperspectral Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Michael Liebling,et al.  Wavelet domain mutual information synchronization of multimodal cardiac microscopy image sequences , 2009, Optical Engineering + Applications.

[14]  Nahum Gat,et al.  Imaging spectroscopy using tunable filters: a review , 2000, SPIE Defense + Commercial Sensing.

[15]  Michael Liebling,et al.  High‐speed multicolor microscopy of repeating dynamic processes , 2011, Genesis.