Temporal super-resolution microscopy using a hue-encoded shutter.

Limited time-resolution in microscopy is an obstacle to many biological studies. Despite recent advances in hardware, digital cameras have limited operation modes that constrain frame-rate, integration time, and color sensing patterns. In this paper, we propose an approach to extend the temporal resolution of a conventional digital color camera by leveraging a multi-color illumination source. Our method allows for the imaging of single-hue objects at an increased frame-rate by trading spectral for temporal information (while retaining the ability to measure base hue). It also allows rapid switching to standard RGB acquisition. We evaluated the feasibility and performance of our method via experiments with mobile resolution targets. We observed a time-resolution increase by a factor 2.8 with a three-fold increase in temporal sampling rate. We further illustrate the use of our method to image the beating heart of a zebrafish larva, allowing the display of color or fast grayscale images. Our method is particularly well-suited to extend the capabilities of imaging systems where the flexibility of rapidly switching between high frame rate and color imaging are necessary.

[1]  Prasanna Rangarajan,et al.  Active computational imaging for circumventing resolution limits at macroscopic scales. , 2017, Applied optics.

[2]  Ramesh Raskar,et al.  Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Guillermo Sapiro,et al.  Coded aperture compressive temporal imaging , 2013, Optics express.

[4]  Guido Schuster,et al.  High spatio-temporal resolution video with compressed sensing. , 2015, Optics express.

[5]  Ian B Hogue,et al.  Open LED Illuminator: A Simple and Inexpensive LED Illuminator for Fast Multicolor Particle Tracking in Neurons , 2015, PloS one.

[6]  Pedro Almada,et al.  OpenSpinMicroscopy: an open-source integrated microscopy platform , 2013, Nature Methods.

[7]  Stephan Preibisch,et al.  OpenSPIM: an open-access light-sheet microscopy platform , 2013, Nature Methods.

[8]  Nico Stuurman,et al.  Computer Control of Microscopes Using µManager , 2010, Current protocols in molecular biology.

[9]  Anne Sentenac,et al.  Structured illumination microscopy using unknown speckle patterns , 2012, Nature Photonics.

[10]  T. Jovin,et al.  Theory of confocal fluorescence imaging in the programmable array microscope (PAM) , 1998 .

[11]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH 2006.

[12]  M. Gustafsson Surpassing the lateral resolution limit by a factor of two using structured illumination microscopy , 2000, Journal of microscopy.

[13]  Kevin G. Chan,et al.  Simultaneous Temporal Superresolution and Denoising for Cardiac Fluorescence Microscopy , 2016, IEEE Transactions on Computational Imaging.

[14]  L H Schaefer,et al.  Structured illumination microscopy: artefact analysis and reduction utilizing a parameter optimization approach , 2004, Journal of microscopy.

[15]  P. Holland,et al.  Robust regression using iteratively reweighted least-squares , 1977 .

[16]  Michael Liebling,et al.  Fast fluorescence microscopy for imaging the dynamics of embryonic development , 2008, HFSP journal.

[17]  R. Pepperkok,et al.  Spectral imaging and its applications in live cell microscopy , 2003, FEBS letters.

[18]  Yaron Caspi,et al.  Under the supervision of , 2003 .

[19]  S. S. Gorthi,et al.  Fluorescence imaging of flowing cells using a temporally coded excitation. , 2013, Optics express.

[20]  Lawrence Carin,et al.  Spectral-temporal compressive imaging. , 2015, Optics letters.

[21]  Vincent Loriette,et al.  Bayesian Estimation for Optimized Structured Illumination Microscopy , 2012, IEEE Transactions on Image Processing.

[22]  Xiaolin Wu,et al.  Coded Acquisition of High Frame Rate Video , 2014, IEEE Transactions on Image Processing.

[23]  Henry Pinkard,et al.  Advanced methods of microscope control using μManager software. , 2014, Journal of biological methods.

[24]  W. Lukosz Optical Systems with Resolving Powers Exceeding the Classical Limit , 1966 .

[25]  I. Daubechies,et al.  Iteratively reweighted least squares minimization for sparse recovery , 2008, 0807.0575.

[26]  Nico Stuurman,et al.  High-resolution imaging of cardiomyocyte behavior reveals two distinct steps in ventricular trabeculation , 2014, Development.

[27]  Peter Kohl,et al.  Temporal Pixel Multiplexing for simultaneous high-speed high-resolution imaging , 2010, Nature Methods.

[28]  R. Heintzmann,et al.  Saturated patterned excitation microscopy--a concept for optical resolution improvement. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.