Measuring shape and motion of a high-speed object with designed features from motion blurred images

Abstract Vision-based geometry measurement plays a crucial role in many science and industrial areas. Plenty of researches devoted to measuring static objects, while few focused on motion blurred situations, which inevitably arise when the object being measured moves fast relative to the camera(s). Motion blur usually invalids the vision-based measurement algorithms designated for static objects. In this paper, we devote to accurate three dimensional (3D) reconstruction of moving objects from motion blurred stereo image pairs. A convolutional neural network (CNN) based method is first proposed to recognize the motion blurred visual targets. A motion blur model based on inner-frame path superposition imaging is then established. Finally, an optimization framework is set up to reconstruct the 3D target motion path during the camera exposure. Experiments are involved to demonstrate the validity and accuracy of the method.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  J. Wen,et al.  Identification of Fast-Rate Systems Using Slow-Rate Image Sensor Measurements , 2014, IEEE/ASME Transactions on Mechatronics.

[3]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Ling Shao,et al.  Image Blur Classification and Parameter Identification Using Two-stage Deep Belief Networks , 2013, BMVC.

[6]  Wolfram Burgard,et al.  A visual odometry framework robust to motion blur , 2009, 2009 IEEE International Conference on Robotics and Automation.

[7]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[8]  Ying Wu,et al.  Motion from blur , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  H. F. Helbig,et al.  A system for automatic electrical and optical characterization of microelectromechanical devices , 1999 .

[10]  Guobao Wang,et al.  A biologically inspired method for estimating 2D high-speed translational motion , 2005, Pattern Recognit. Lett..

[11]  Shree K. Nayar,et al.  Motion-based motion deblurring , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Richard Szeliski,et al.  PSF estimation using sharp edge prediction , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Yehoshua Y. Zeevi,et al.  Quasi Maximum Likelihood Blind Deconvolution of Images Using Optimal Sparse Representations , 2003 .

[14]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, CVPR.

[15]  Zhao Zhuan-ping.  Field Calibration of Binocular Stereo System Based on Planar Template and Free Snapping , 2007 .

[16]  Qian Li,et al.  A computer vision method for measuring angular velocity , 2007 .

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Sung Joon Ahn,et al.  Circular Coded Target for Automation of Optical 3D-Measurement and Camera Calibration , 2001, Int. J. Pattern Recognit. Artif. Intell..

[19]  Jan Kotera,et al.  Convolutional Neural Networks for Direct Text Deblurring , 2015, BMVC.

[20]  Anthon Voigt,et al.  An Inexpensive, Automatic and Accurate Camera Calibration Method , 2005 .

[21]  Michal Hradiš,et al.  CNN for license plate motion deblurring , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[22]  Jiaya Jia,et al.  Single Image Motion Deblurring Using Transparency , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.