High-speed tracking system based on Multi-parallel-core processor and CNN algorithm

This paper proposes a high-speed tracking system based on a multi-parallel-core processor architecture and a convolution neural network (CNN)-based tracking algorithm. Multiple processing cores are designed in the processor architecture, and they can parallel carry out operations. Each processing core can access data from another processing core through a interconnect control module (ICM), which make it easy to run CNN. Other components, such as Microprocessor Unit (MPU) and Data Transfer Control Module (DTCM), are also designed for global controlling and data transmitting. The proposed tracking algorithm is based on CNN which mainly contains three convolution (CONV) layers and one full connection (FC) layer. Based on an analysis of equivalence, the softmax layer is discarded when inferring. Because the conciseness and the effectiveness, the algorithm can be executed efficiently on the processor architecture, and Experiment results demonstrate that the tracking system based on the proposed algorithm and processor can achieve high-speed target tracking up to 880 fps.

[1]  Horst Bischof,et al.  Semi-supervised On-Line Boosting for Robust Tracking , 2008, ECCV.

[2]  Liyuan Liu,et al.  High-speed target tracking system based on multi-interconnection heterogeneous processor and multi-descriptor algorithm , 2017, Science China Information Sciences.

[3]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[4]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Idaku Ishii,et al.  A digital vision chip specialized for high-speed target tracking , 2003 .

[6]  Liyuan Liu,et al.  High-Speed Target Tracking System Based on a Hierarchical Parallel Vision Processor and Gray-Level LBP Algorithm , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[7]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Horst Bischof,et al.  Real-Time Tracking via On-line Boosting , 2006, BMVC.

[9]  Ali Farhadi,et al.  Re$^3$: Re al-Time Recurrent Regression Networks for Visual Tracking of Generic Objects , 2017, IEEE Robotics and Automation Letters.

[10]  Bo Zhao,et al.  A 64$\,\times\,$64 CMOS Image Sensor With On-Chip Moving Object Detection and Localization , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Liyuan Liu,et al.  Heterogeneous vision chip and LBP-based algorithm for high-speed tracking , 2014 .

[12]  Zhongxing Zhang,et al.  High-speed visual tracking with mixed rotation invariant description , 2016 .