1000-fps real-time optical flow detection system

Real-time optical flow detection at 1000 fps was realized by implementing an improved optical flow detection algorithm as hardware logic on a high-speed vision platform. The improved gradient-based algorithm, which is based on the Lucas-Kanade algorithm, can select a pseudo variable frame rate adaptively according to the amplitude of optical flow to estimate the accurate optical flow for objects moving at high speeds and low speeds in the same scene. The high-speed vision platform on which the optical flow detection algorithm is implemented can be used to calculate optical flow at 1000 fps for images of 1024 x 1024 pixels; by considering real scenarios such as rapid human motion, the performance of our developed optical flow detection algorithm and system was verified.

[1]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  Daryl T. Lawton,et al.  Processing translational motion sequences , 1983, Comput. Vis. Graph. Image Process..

[4]  Shmuel Peleg,et al.  Computing two motions from three frames , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[5]  Francis Devos,et al.  A programmable artificial retina , 1993 .

[6]  Jan-Erik Eklund,et al.  VLSI implementation of a focal plane image processor-a realization of the near-sensor image processing concept , 1996, IEEE Trans. Very Large Scale Integr. Syst..

[7]  Rama Chellappa,et al.  Accuracy vs Efficiency Trade-offs in Optical Flow Algorithms , 1996, Comput. Vis. Image Underst..

[8]  M. Ishikawa,et al.  A dynamically reconfigurable SIMD processor for a vision chip , 2003, IEEE Journal of Solid-State Circuits.

[9]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[10]  Shinichi Hirai,et al.  Realtime FPGA-Based Vision System , 2005, J. Robotics Mechatronics.

[11]  Unai Bidarte,et al.  Hardware implementation of optical flow constraint equation using FPGAs , 2005, Comput. Vis. Image Underst..

[12]  Javier Díaz,et al.  FPGA-based real-time optical-flow system , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  I. Ishii,et al.  Higher Order Autocorrelation Vision Chip , 2006, IEEE Transactions on Electron Devices.

[14]  Masatoshi Ishikawa,et al.  955-fps Real-time Shape Measurement of a Moving/Deforming Object using High-speed Vision for Numerous-point Analysis , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[15]  Dah-Jye Lee,et al.  FPGA-based Real-time Optical Flow Algorithm Design and Implementation , 2007, J. Multim..

[16]  Idaku Ishii,et al.  Development of high-speed and real-time vision platform, H3 vision , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.