Velocity Estimation From a Single Linear Motion Blurred Image Using Discrete Cosine Transform

There is a growing trend to use a digital camera as an instrument to measure velocity instead of a regular sensor approach. This paper introduces a new proposal for estimating kinematic quantities, namely, the angle and the relative speed, from a single motion blur image using the discrete cosine transform (DCT). Motion blur is a common phenomenon present in images due to the relative movement between the camera and the objects, during sensor exposure to light. Today, this source of kinematic data is mostly dismissed. The introduced technique focuses on cases where the camera moves at a constant linear velocity while the background remains unchanged. 2250 motion blur pictures were shot for the angle experiments and 500 for the speed estimation experiments, in a light and distance controlled environment, using a belt motor slider driven at angles between 0° and 90° and 10 preset speeds. The DCT Hough and DCT Radon results were compared to discrete Fourier transform (DFT) Hough and DFT Radon algorithms for angle estimation. The mean absolute error of the DCT Radon method for direction estimation was 4.66°. In addition, the mean relative error for speed estimation of the DCT Pseudocepstrum was 5.15%. The innovative DCT frequency analysis proposals were more accurate than all competitors evaluated for the reconstruction of the point spread function that enables calculation of relative velocity and motion direction. These results demonstrate that cameras as an instrument can be used to measure velocity even using a single linear motion blur degraded image.

[1]  Ali Taherkhani,et al.  Object Speed Estimation in Frequency Domain of Single Taken Image , 2013 .

[2]  Sidney Nascimento Givigi,et al.  Velocity Estimation for Autonomous Vehicles Based on Image Analysis , 2016, IEEE Transactions on Instrumentation and Measurement.

[3]  Sing Yiu Cheung,et al.  Traffic Surveillance with Wireless Magnetic Sensors , 2005 .

[4]  Yasuo Yoshida,et al.  Parameter Estimation of Uniform Image Blur Using DCT (Special Section of Letters Selected from the 1993 IEICE Spring Conference) , 1993 .

[5]  G. Heming,et al.  Particle velocity measurement using linear capacitive sensor matrix , 2017, 2017 13th IEEE International Conference on Electronic Measurement & Instruments (ICEMI).

[6]  David Zhang,et al.  Selecting a Reference High Resolution for Fingerprint Recognition Using Minutiae and Pores , 2011, IEEE Transactions on Instrumentation and Measurement.

[7]  Michael Anthony Bauer,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT 1 Portable and Scalable Vision-Based Vehicular Instrument , 2022 .

[8]  Yitzhak Yitzhaky,et al.  Restoration of interlaced images degraded by variable velocity motion , 2003 .

[9]  Benjamin Pfaff,et al.  Handbook Of Image And Video Processing , 2016 .

[10]  Zhao Peng,et al.  Image motion-blur-based object's speed measurement using an interlaced scan image , 2010 .

[11]  Wilhelm Burger,et al.  Principles of Digital Image Processing , 2013, Undergraduate Topics in Computer Science.

[12]  W. Kruger,et al.  Real-time estimation and tracking of optical flow vectors for obstacle detection , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[13]  Alfredo Paolillo,et al.  Face Based Recognition Algorithms: A First Step Toward a Metrological Characterization , 2013, IEEE Transactions on Instrumentation and Measurement.

[14]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Jan Flusser,et al.  Space-Variant Restoration of Images Degraded by Camera Motion Blur , 2008, IEEE Transactions on Image Processing.

[16]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Behnoosh Hariri,et al.  A yawning measurement method using embedded smart cameras , 2013, 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[18]  Zhe Wang,et al.  An image filter technique to relax particle image velocimetry , 2011, 2011 19th European Signal Processing Conference.

[19]  Jacob Scharcanski,et al.  Yawning Detection Using Embedded Smart Cameras , 2016, IEEE Transactions on Instrumentation and Measurement.

[20]  Nahum Kiryati,et al.  Progress in the restoration of image sequences degraded by atmospheric turbulence , 2014, Pattern Recognit. Lett..

[21]  Shervin Shirmohammadi,et al.  Driver drowsiness monitoring based on yawning detection , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[22]  T. R. Shives,et al.  Technology advances in engineering and their impact on detection, diagnosis, and prognosis methods : proceedings of the 36th Meeting of the Mechanical Failures Prevention Group, LaPosada Hotel, Scottsdale, Arizona, December 6-10, 1982 , 1983 .

[23]  Huei-Yung Lin,et al.  Vehicle Speed Estimation from Single Still Images Based on Motion Blur Analysis , 2005, MVA.

[24]  Shinji Yamamoto Development of inspection robot for nuclear power plant , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[25]  Michael Potmesil,et al.  Modeling motion blur in computer-generated images , 1983, SIGGRAPH.

[26]  Jeff S. Shamma,et al.  Vehicle Classification and Speed Estimation Using Combined Passive Infrared/Ultrasonic Sensors , 2018, IEEE Transactions on Intelligent Transportation Systems.

[27]  Alejandro Forero,et al.  URSULA: Robotic Demining System , 2003 .

[28]  Les Kirkup,et al.  An Introduction to Uncertainty in Measurement: Using the GUM (Guide to the Expression of Uncertainty in Measurement) , 2006 .

[29]  Shamik Tiwari,et al.  Review of Motion Blur Estimation Techniques , 2014 .

[30]  S. B. Kang,et al.  Image deblurring using inertial measurement sensors , 2010, SIGGRAPH 2010.

[31]  M. R. Khare Automatic System for Measuring and Controlling the Length of a Moving Product in Industries , 2008, IEEE Transactions on Instrumentation and Measurement.

[32]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[33]  Tony F. Chan,et al.  Image processing and analysis - variational, PDE, wavelet, and stochastic methods , 2005 .

[34]  E. Uchino,et al.  Robust Identification of Motion Blur Parameters by Using Angles of Gradient Vectors , 2006, 2006 International Symposium on Intelligent Signal Processing and Communications.

[36]  Keigo Hirakawa,et al.  Fast spatially varying object motion blur estimation , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[37]  J. Alberola,et al.  Vehicle detection and car speed monitoring system using GMR magnetic sensors , 2002, IEEE 2002 28th Annual Conference of the Industrial Electronics Society. IECON 02.

[38]  Jin-xiang Wang,et al.  Research of vehicle speed detection algorithm in video surveillance , 2016, 2016 International Conference on Audio, Language and Image Processing (ICALIP).

[39]  Libor Machala,et al.  Blurred image restoration: A fast method of finding the motion length and angle , 2010, Digit. Signal Process..

[40]  Brendt Wohlberg,et al.  Blind Image Deconvolution Motion Blur Estimation , 2006 .

[41]  Yasuo Konishi,et al.  Estimation of motion using motion blur for tracking vision system , 2002, Proceedings of the 5th Biannual World Automation Congress.

[42]  M. Cannon Blind deconvolution of spatially invariant image blurs with phase , 1976 .

[43]  Deepa Kundur,et al.  Blind Image Deconvolution , 2001 .

[44]  Huei-Yung Lin,et al.  Vehicle Speed Detection and Identification from a Single Motion Blurred Image , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[45]  Alessandro Ferrero,et al.  Camera as the instrument: the rising trend of vision based measurement , 2014, IEEE Instrumentation & Measurement Magazine.

[46]  Babak Nadjar Araabi,et al.  A real-time velocity estimation using motion blur in air hockey , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[47]  3D Particle image velocimetry using correlation image sensor , 2011, SICE Annual Conference 2011.

[48]  Heinrich Garn,et al.  Estimation of Vehicle Speed Based on Asynchronous Data from a Silicon Retina Optical Sensor , 2006, 2006 IEEE Intelligent Transportation Systems Conference.

[49]  Zhen Liu,et al.  Automatic Fault Detection of Multiple Targets in Railway Maintenance Based on Time-Scale Normalization , 2018, IEEE Transactions on Instrumentation and Measurement.

[50]  Huei-Yung Lin,et al.  Motion blur removal and its application to vehicle speed detection , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[52]  Mansour Jamzad,et al.  Linear Motion Blur Parameter Estimation in Noisy Images Using Fuzzy Sets and Power Spectrum , 2007, EURASIP J. Adv. Signal Process..

[53]  Alan C. Bovik,et al.  The Essential Guide to Image Processing , 2009, J. Electronic Imaging.

[54]  Rama Chellappa,et al.  Motion Deblurring: Algorithms and Systems , 2014 .

[55]  Robert B. Randall,et al.  A history of cepstrum analysis and its application to mechanical problems , 2017 .

[56]  Ehsan Saeedi,et al.  Object Speed Estimation by using Fuzzy Set , 2010 .

[57]  Yong Yan,et al.  Velocity measurement of pneumatically conveyed particles through digital imaging , 2009 .

[58]  Kazuya Yoshida,et al.  Emergency response to the nuclear accident at the Fukushima Daiichi Nuclear Power Plants using mobile rescue robots , 2013, J. Field Robotics.

[59]  Ya Tian,et al.  Accurate Human Navigation Using Wearable Monocular Visual and Inertial Sensors , 2014, IEEE Transactions on Instrumentation and Measurement.

[60]  Jan Flusser,et al.  Recent Advances in Space-Variant Deblurring and Image Stabilization , 2009 .

[61]  Paolo Fiorini,et al.  Search and Rescue Robotics , 2008, Springer Handbook of Robotics.

[62]  S. Patnaik,et al.  Radon transform based uniform and non-uniform motion blur parameter estimation , 2012, 2012 International Conference on Communication, Information & Computing Technology (ICCICT).

[63]  Mubarak Shah,et al.  Determining driver visual attention with one camera , 2003, IEEE Trans. Intell. Transp. Syst..

[64]  Wolfram Burgard,et al.  A visual odometry framework robust to motion blur , 2009, 2009 IEEE International Conference on Robotics and Automation.

[65]  Ying Wu,et al.  Motion from blur , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[66]  Feng Li,et al.  Blurred target tracking by Blur-driven Tracker , 2011, 2011 International Conference on Computer Vision.

[67]  Rodrigo Minetto,et al.  A Video-Based System for Vehicle Speed Measurement in Urban Roadways , 2017, IEEE Transactions on Intelligent Transportation Systems.

[68]  H. Hassanein,et al.  On the use of discrete cosine transform in cepstral analysis , 1984 .

[69]  John G. Webster,et al.  The Measurement, Instrumentation and Sensors Handbook , 1998 .

[70]  Max Q.-H. Meng,et al.  Motion blur removal for humanoid robots , 2012, 2012 IEEE International Conference on Automation and Logistics.

[71]  Oswaldo Horikawa,et al.  VELOCITY MEASUREMENT BASED ON IMAGE BLUR , 2008 .

[72]  Limin Jia,et al.  Some practical vehicle speed estimation methods by a single traffic magnetic sensor , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[73]  Babak Nadjar Araabi,et al.  Pigment Melanin: Pattern for Iris Recognition , 2009, IEEE Transactions on Instrumentation and Measurement.

[74]  Jing Wang,et al.  Improved Particle Image Velocimetry Through Cell Segmentation and Competitive Survival , 2008, IEEE Transactions on Instrumentation and Measurement.

[75]  Ulrich Schwanecke,et al.  Blind Image Deconvolution of Linear Motion Blur , 2011, ICCV 2011.

[76]  B. P. Bogert,et al.  The quefrency analysis of time series for echoes : cepstrum, pseudo-autocovariance, cross-cepstrum and saphe cracking , 1963 .

[77]  Guillermo Leon Ramirez Clavijo,et al.  Detection of visual fatigue by analyzing the blink rate , 2015 .

[78]  Ratnakar Dash Parameters Estimation For Image Restoration , 2012 .

[79]  Chunhua Liu,et al.  Velocity Measurement Technique for Permanent Magnet Synchronous Motors Through External Stray Magnetic Field Sensing , 2018, IEEE Sensors Journal.

[80]  Yitzhak Yitzhaky,et al.  Identification of blur parameters from motion-blurred images , 1996, Optics & Photonics.

[81]  Chandrasekhar Kambhampati,et al.  The current opinion on the use of robots for landmine detection , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).