Real-time target tracking and positioning on FPGA

Recently, FPGA becomes more important and popular in embedded systems due to its parallelizable inner structures. In this paper, a pipelined FPGA architecture will be present which will be used on a mobile robot. It implements algorithms about target recognition, tracking, positioning based on monocular vision, etc. The hardware platform for the design is the development board by Xilinx. The system uses monocular camera to measure the orientation of target in real time. It acquires the video stream from CMOS camera. The system realizes target tracking by extracting the color of the target as the feature, filtering, detecting feature of the target and then displaying on the screen. The system realizes target positioning according to the centroid of the tracked target, then computing the orientation which can be used for the intelligent robot vision.

[1]  Wei You,et al.  Real-time multiple object tracking in smart environments , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[2]  Tamer Shanableh,et al.  FPGA-Based Parallel Hardware Architecture for Real-Time Image Classification , 2015, IEEE Transactions on Computational Imaging.

[3]  Yuan-Pao Hsu,et al.  FPGA implementation of a real-time image tracking system , 2010, Proceedings of SICE Annual Conference 2010.

[4]  Stanley A. Schneider,et al.  Object impedance control for cooperative manipulation: theory and experimental results , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[5]  Jani Boutellier,et al.  Application-specific instruction processor for extracting local binary patterns , 2012, Proceedings of the 2012 Conference on Design and Architectures for Signal and Image Processing.

[6]  Sung Min Kim,et al.  Novel object tracking method using the block-based motion estimation , 2007, SICE Annual Conference 2007.

[7]  Tom Drummond,et al.  Algorithmic methodologies for FPGA-based vision , 2012, Machine Vision and Applications.

[8]  Qiang Zhan,et al.  Automatic Navigation for A Mobile Robot with Monocular Vision , 2008, 2008 IEEE Conference on Robotics, Automation and Mechatronics.

[9]  B. Ugur Töreyin,et al.  A two stage template matching algorithm and its İmplementation on FPGA , 2015, 2015 23nd Signal Processing and Communications Applications Conference (SIU).

[10]  Wei Lu,et al.  The Method of Real-Time Distance Measurement Based on Monocular Vision , 2011 .

[11]  Wu-Chih Hu.  Adaptive Template Block-Based Block Matching for Object Tracking , 2008, 2008 Eighth International Conference on Intelligent Systems Design and Applications.

[12]  David Gerónimo Gómez,et al.  Survey of Pedestrian Detection for Advanced Driver Assistance Systems , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Accelerating High-Performance Computing With FPGAs , 1998 .

[14]  Tu Ya,et al.  Application of FPGA in direct current motor servo system , 2008, 2008 27th Chinese Control Conference.

[15]  Spyridon Nikolaidis,et al.  FPGA-based machine vision implementation for Lab-on-Chip flow detection , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[16]  Ronald Poppe,et al.  Vision-based human motion analysis: An overview , 2007, Comput. Vis. Image Underst..

[17]  Zhao Wei.  Fast Matching Algorithm Based on Corner Detection , 2011 .

[18]  Jay A. Farrell,et al.  Real-Time Computer Vision/DGPS-Aided Inertial Navigation System for Lane-Level Vehicle Navigation , 2012, IEEE Transactions on Intelligent Transportation Systems.

[19]  Chung-Hao Chen,et al.  A Moving Object Tracked by A Mobile Robot with Real-Time Obstacles Avoidance Capacity , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[20]  Jae-Bok Song,et al.  Mobile robot localization based on effective combination of vision and range sensors , 2009 .

[21]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..