Temporally Coded Exposure Camera for High-Speed Feedback of Microscopic 3D Information

We proposed and developed a temporally coded exposure (TeCE) camera that can carry out multiple exposures at arbitrary timing and accumulate photoelectrons generated by the multiple exposures in a single frame in order to feedback microscopic 3D information at high speed. The TeCE camera can capture a different plane in each frame in synchronization with a high-speed variable-focus lens, called a tunable acoustic gradient index (TAG) lens, because the TeCE camera can extract a particular focal plane from the TAG lens by synchronizing the short exposure control with the focus changing frequencyof the TAG lens. This allows the TeCE camera to acquire microscopic 3D information from different focal planes. To verify the effectiveness of the TeCE camera, an experiment involving feedback of 3D structure of a microscopic object was conducted. The experimental results showed that the TeCE camera could achieve high-speed 3D measurement and good feedback control.

[1]  Aaron S. Andalman,et al.  Enhancing the performance of the light field microscope using wavefront coding. , 2014, Optics express.

[2]  Benjamin Schmid,et al.  Rapid 3D light-sheet microscopy with a tunable lens. , 2013, Optics express.

[3]  F. Arai,et al.  Laser-driven gel microtool for single-cell manipulation based on temperature control with a photothermal conversion material , 2016 .

[4]  Koichi Hashimoto,et al.  Two-dimensional tracking of a motile micro-organism allowing high-resolution observation with various imaging techniques , 2005 .

[5]  M Fraldi,et al.  Digital holography as 3D tracking tool for assessing acoustophoretic particle manipulation. , 2017, Optics express.

[6]  Tatsuo Arai,et al.  Development of the 3D measurement system in real-time for micro-manipulation , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).

[7]  G. Ballantyne.  Robotic surgery, telerobotic surgery, telepresence, and telementoring , 2002, Surgical Endoscopy And Other Interventional Techniques.

[8]  Ryuichi Tanimoto,et al.  High-speed microscopy with an electrically tunable lens to image the dynamics of in vivo molecular complexes. , 2015, The Review of scientific instruments.

[9]  Myung K. Kim,et al.  Review of digital holographic microscopy for three-dimensional profiling and tracking , 2014 .

[10]  Éric Marchand,et al.  CAD Model-based Tracking and 3D Visual-based Control for MEMS Microassembly , 2010, Int. J. Robotics Res..

[11]  Martí Duocastella,et al.  Simultaneous imaging of multiple focal planes for three-dimensional microscopy using ultra-high-speed adaptive optics. , 2012, Journal of biomedical optics.

[12]  Kazuki Yamato,et al.  1-ms Three-Dimensional Feedback Microscope With 69-kHz Synchronous Modulation of Focal Position and Illumination , 2018, IEEE Robotics and Automation Letters.

[13]  H. Oku,et al.  Development of a coded exposure camera for high-speed 3D measurement using microscope , 2018 .

[14]  Euan McLeod,et al.  High-speed varifocal imaging with a tunable acoustic gradient index of refraction lens. , 2008, Optics letters.

[15]  Daniel Ahmed,et al.  Rotational manipulation of single cells and organisms using acoustic waves , 2016, Nature Communications.

[16]  Masatoshi Ishikawa,et al.  High-speed liquid lens for computer vision , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  Jian Sheng,et al.  Imaging bacterial 3D motion using digital in-line holographic microscopy and correlation-based de-noising algorithm. , 2014, Optics express.

[18]  Masatoshi Ishikawa,et al.  High-speed autofocusing of a cell using diffraction patterns , 2006 .

[19]  Rodrigo Cuenca,et al.  Optical axial scanning in confocal microscopy using an electrically tunable lens. , 2014, Biomedical optics express.