Motion-blur-free microscopic video shooting based on frame-by-frame intermittent tracking

We develop a motion-blur-free microscope for shooting non-blurred videos of moving objects by implementing a frame-by-frame intermittent tracking method with a microscopic high-speed tracking system that controls the position of the objective lens using high-frame-rate video processing. With our tracking method, the control target alternates at several hundred hertz, according to the camera's shutter state. The apparent speed of the target object in the captured images is maintained at zero to suppress motion blur when the shutter is open, and the camera's position returns to its home position when the shutter is closed. Our motion-blur-free microscope can shoot non-blurred 512×512 images at 125 fps with frame-by-frame intermittent tracking for objects moving unidirectionally. Compared with the degradation in video that was recorded without tracking, our method reduces image degradation from motion blur 1/40 times or less without decreasing the exposure time when a 10× objective lens is attached. Its performance is verified by showing the experimental results from several moving scenes in microscopic view.

[1]  J. Paik,et al.  Out-of-focus blur estimation and restoration for digital auto-focusing system , 1998 .

[2]  Takeshi Takaki,et al.  High-Frame-Rate Optical Flow System , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Sundaresh Ram,et al.  Removing Camera Shake from a Single Photograph , 2009 .

[4]  K. Egiazarian,et al.  Blind image deconvolution , 2007 .

[5]  Frédo Durand,et al.  Motion-invariant photography , 2008, ACM Trans. Graph..

[6]  Michael Elad,et al.  Fast and robust multiframe super resolution , 2004, IEEE Transactions on Image Processing.

[7]  Andrew Blake,et al.  Motion Deblurring and Super-resolution from an Image Sequence , 1996, ECCV.

[8]  Takeshi Takaki,et al.  2000 fps real-time vision system with high-frame-rate video recording , 2010, 2010 IEEE International Conference on Robotics and Automation.

[9]  Hiromasa Oku,et al.  Tracking a protozoon using high-speed visual feedback , 2000, 1st Annual International IEEE-EMBS Special Topic Conference on Microtechnologies in Medicine and Biology. Proceedings (Cat. No.00EX451).

[10]  Idaku Ishii,et al.  Development of high-speed and real-time vision platform, H3 vision , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Yoshiro Imai,et al.  Development of a high-speed multifingered hand system and its application to catching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[12]  Jia Chen,et al.  Robust dual motion deblurring , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Jean-Luc Starck,et al.  Deconvolution and Blind Deconvolution in Astronomy , 2007 .

[14]  Masatoshi Ishikawa,et al.  High-speed gaze controller for millisecond-order pan/tilt camera , 2011, 2011 IEEE International Conference on Robotics and Automation.

[15]  Masatoshi Ishikawa,et al.  955-fps Real-time Shape Measurement of a Moving/Deforming Object using High-speed Vision for Numerous-point Analysis , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[16]  Takeshi Takaki,et al.  500-fps face tracking system , 2012, Journal of Real-Time Image Processing.

[17]  Subhasis Chaudhuri,et al.  Blind Image Deconvolution , 2014, Springer International Publishing.

[18]  Michael S. Brown,et al.  Richardson-Lucy Deblurring for Scenes under a Projective Motion Path , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.