Parallel Implementation of Dense Optical Flow Computation on Many-Core Processor

Computation of optical flow is a fundamental step in computer vision applications. However, due to its high complexity, it is difficult to compute a high-accuracy optical flow field in real time. This paper proposes a parallel computing approach for fast computation of high-accuracy optical flow field. It is specially designed for Tilera, a typical many-core processor with 36 tiles. By efficiently exploiting the advantages of the mesh architecture of Tilera, and by appropriately handling the parallelism inherent in the optical flow computation, the proposed implemention is able to significantly reduce the computation time while keep a low power consumption. Experiment shows that, for a \(640 {\times } 480\) image, the computation time is only 0.80 seconds per frame. It is 2.56 times faster than on a typical CPU i3-3240 (3.4GHz), and the power consumption as less as 1/6. Experimental results also show that the proposed parallel approach is highly scalable for variable requirements on computation speeds and power consumptions, since it can flexibly selects a proper number of computing cores.

[1]  Thomas Brox,et al.  High Accuracy Optical Flow Estimation Based on a Theory for Warping , 2004, ECCV.

[2]  Joachim Weickert,et al.  Towards ultimate motion estimation: combining highest accuracy with real-time performance , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Afsar Saranli,et al.  An FPGA based high performance optical flow hardware design for computer vision applications , 2013, Microprocess. Microsystems.

[4]  Joachim Weickert,et al.  Variational optic flow on the Sony PlayStation 3 , 2010, Journal of Real-Time Image Processing.

[5]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[6]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[7]  Nahum Kiryati,et al.  Piecewise-Smooth Dense Optical Flow via Level Sets , 2006, International Journal of Computer Vision.

[8]  Pedro Cobos Arribas,et al.  FPGA implementation of Santos-Victor optical flow algorithm for real-time image processing: an useful attempt , 2003 .

[9]  Joachim Weickert,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Optic Flow in Harmony Optic Flow in Harmony Optic Flow in Harmony , 2022 .

[10]  Yongdong Zhang,et al.  Parallel Deblocking Filter for H.264/AVC on the TILERA Many-Core Systems , 2011, MMM.

[11]  Michael J. Black,et al.  The Robust Estimation of Multiple Motions: Parametric and Piecewise-Smooth Flow Fields , 1996, Comput. Vis. Image Underst..

[12]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[13]  Kurt Keutzer,et al.  Dense Point Trajectories by GPU-Accelerated Large Displacement Optical Flow , 2010, ECCV.

[14]  Yoshiki Mizukami,et al.  Optical Flow Computation on Compute Unified Device Architecture , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[15]  Yasuyuki Matsushita,et al.  Motion detail preserving optical flow estimation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  David J. Fleet,et al.  Performance of optical flow techniques , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Andrew E. Johnson,et al.  Investigation of the Tilera processor for real time hazard detection and avoidance on the Altair Lunar Lander , 2010, 2010 IEEE Aerospace Conference.

[18]  Jitendra Malik,et al.  Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Unai Bidarte,et al.  Hardware implementation of optical flow constraint equation using FPGAs , 2005, Comput. Vis. Image Underst..

[20]  Jitendra Malik,et al.  Occlusion boundary detection and figure/ground assignment from optical flow , 2011, CVPR 2011.

[21]  Jitendra Malik,et al.  Large displacement optical flow , 2009, CVPR.

[22]  N. H. Hamid,et al.  FPGA-based hardware implementation of optical flow constraint equation of Horn and Schunck , 2012, 2012 4th International Conference on Intelligent and Advanced Systems (ICIAS2012).