Single-shot real-time optical imaging using compressed optical-streaking ultra-high-speed photography

Single-shot real-time ultra-high-speed imaging is of significance in capturing transient phenomena. Existing techniques fall short in possessing satisfying specifications in the imaging speed, sequence depth, and pixel count. To overcome these limitations, we have developed compressed optical-streaking ultra-high-speed photography (COSUP) that records a scene (x, y, t) by applying the operations of spatial encoding, temporal shearing, and spatiotemporal integrating. The COSUP system possesses an imaging speed of 1.5 million frames per second (fps), a sequence depth of 500 frames, and a pixel count of 0.5 megapixels per frame. COSUP is demonstrated by imaging single laser pulses illuminating through transmissive targets and by tracking a fast-moving object. We envision COSUP to be applied in widespread applications in biomedicine and materials science.

[1]  Lihong V. Wang,et al.  Single-shot stereo-polarimetric compressed ultrafast photography for light-speed observation of high-dimensional optical transients with picosecond resolution , 2020, Nature Communications.

[2]  Liren Zhu,et al.  Single-shot real-time video recording of a photonic Mach cone induced by a scattered light pulse , 2017, Science Advances.

[3]  Liang Gao,et al.  Ultrafast optical imaging technology: principles and applications of emerging methods , 2016 .

[4]  Daniel J Heinzen,et al.  Grayscale laser image formation using a programmable binary mask , 2012 .

[5]  Chiye Li,et al.  Single-shot compressed ultrafast photography at one hundred billion frames per second , 2014, Nature.

[6]  K. Goda,et al.  Dispersive Fourier transformation for fast continuous single-shot measurements , 2013, Nature Photonics.

[7]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[8]  Detlef Lohse,et al.  Brandaris 128: A digital 25 million frames per second camera with 128 highly sensitive frames , 2003 .

[9]  Scott S. Howard,et al.  Frequency Multiplexed In Vivo Multiphoton Phosphorescence Lifetime Microscopy , 2012, Nature Photonics.

[10]  B. Jalali,et al.  Serial time-encoded amplified imaging for real-time observation of fast dynamic phenomena , 2009, Nature.

[11]  Jinyang Liang,et al.  Single-shot real-time sub-nanosecond electron imaging aided by compressed sensing: Analytical modeling and simulation. , 2019, Micron.

[12]  L. Tian,et al.  Single‐Shot Ultraviolet Compressed Ultrafast Photography , 2020, Laser & Photonics Reviews.

[13]  Andy K. S. Lau,et al.  Ultrafast laser-scanning time-stretch imaging at visible wavelengths , 2016, Light: Science & Applications.

[14]  David R. Smith,et al.  Metamaterial Apertures for Computational Imaging , 2013, Science.

[15]  Rihito Kuroda,et al.  A Preliminary Chip Evaluation toward Over 50Mfps Burst Global Shutter Stacked CMOS Image Sensor , 2018 .

[16]  Lihong V Wang,et al.  Single-shot ultrafast optical imaging. , 2018, Optica.

[17]  Daniel Jaque,et al.  Luminescence nanothermometry. , 2012, Nanoscale.

[18]  Jinyang Liang,et al.  Homogeneous one-dimensional optical lattice generation using a digital micromirror device-based high-precision beam shaper , 2012 .

[19]  Lihong V Wang,et al.  Single-shot real-time femtosecond imaging of temporal focusing , 2018, Light: Science & Applications.

[20]  Jinyang Liang.  Punching holes in light: recent progress in single-shot coded-aperture optical imaging , 2020, Reports on progress in physics. Physical Society.

[21]  Benjamin D. Buckner,et al.  Digital synchroballistic schlieren camera for high-speed photography of bullets and rocket sleds , 2013 .

[22]  Rama Chellappa,et al.  P2C2: Programmable pixel compressive camera for high speed imaging , 2011, CVPR 2011.

[23]  Jinyang Liang,et al.  Single-shot compressed optical-streaking ultra-high-speed photography. , 2019, Optics letters.

[24]  Vikrant Tiwari,et al.  Assessment of High Speed Imaging Systems for 2D and 3D Deformation Measurements: Methodology Development and Validation , 2007 .

[25]  Elias Kristensson,et al.  FRAME: femtosecond videography for atomic and molecular dynamics , 2017, Light: Science & Applications.

[26]  M. Dong,et al.  Determination of protein structural flexibility by microsecond force spectroscopy. , 2009, Nature nanotechnology.

[27]  Guillermo Sapiro,et al.  Coded aperture compressive temporal imaging , 2013, Optics express.

[28]  Edoardo Charbon,et al.  Toward One Giga Frames per Second — Evolution of in Situ Storage Image Sensors , 2013, Sensors.

[29]  Weijian Yang,et al.  In vivo imaging of neural activity , 2017, Nature Methods.

[30]  Shoji Kawahito,et al.  Single-event transient imaging with an ultra-high-speed temporally compressive multi-aperture CMOS image sensor. , 2016, Optics express.

[31]  Peng Wang,et al.  Single-shot ultrafast imaging attaining 70 trillion frames per second , 2020, Nature Communications.

[32]  Bahram Jalali,et al.  High-throughput single-microparticle imaging flow analyzer , 2012, Proceedings of the National Academy of Sciences.

[33]  Liren Zhu,et al.  Picosecond-resolution phase-sensitive imaging of transparent objects in a single shot , 2020, Science Advances.

[34]  P W W Fuller,et al.  An introduction to high speed photography and photonics , 2009 .

[35]  Jinyang Liang,et al.  Compressed ultrafast transmission electron microscopy: a simulation study , 2019, BiOS.

[36]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.