Real-time motion estimation based on event-based vision sensor

Fast and efficient motion estimation is essential for a number of applications including the gesture-based user interface (UI) for portable devices like smart phones. In this paper, we propose a highly efficient method that can estimate four degree of freedom (DOF) motional components of a moving object based on an event-based vision sensor, the dynamic vision sensor (DVS). The proposed method finds informative events occurred at edges and estimates their velocities for global motion analysis. We will also describe a novel method to correct the aperture problem in the motion estimation.

[1]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[2]  Chiara Bartolozzi,et al.  Asynchronous frameless event-based optical flow , 2012, Neural Networks.

[3]  Tobi Delbrück,et al.  Touchless hand gesture UI with instantaneous responses , 2012, 2012 19th IEEE International Conference on Image Processing.

[4]  Tobias Delbrück,et al.  Frame-free dynamic digital vision , 2008 .

[5]  Bernabé Linares-Barranco,et al.  A 128$\,\times$ 128 1.5% Contrast Sensitivity 0.9% FPN 3 µs Latency 4 mW Asynchronous Frame-Free Dynamic Vision Sensor Using Transimpedance Preamplifiers , 2013, IEEE Journal of Solid-State Circuits.

[6]  Shumin Zhai,et al.  Camera phone based motion sensing: interaction techniques, applications and performance study , 2006, UIST.

[7]  Matthew Turk,et al.  View-based interpretation of real-time optical flow for gesture recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[8]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[9]  Tobi Delbrück,et al.  Live demonstration: Gesture-based remote control using stereo pair of dynamic vision sensors , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[10]  Kyoobin Lee,et al.  Four DoF gesture recognition with an event-based image sensor , 2012, The 1st IEEE Global Conference on Consumer Electronics 2012.

[11]  Sven Kratz.  Gesture Recognition Using Motion Estimation on Mobile Phones , 2007 .

[12]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[13]  Thomas Hahn,et al.  Event-driven body motion analysis for real-time gesture recognition , 2012, 2012 IEEE International Symposium on Circuits and Systems.