Hardware-accelerated pose estimation for embedded systems using Vivado HLS

The focus of this work is to facilitate pose estimation and, thus, gesture recognition for embedded systems, although these are tasks with high computational performance requirements. Therefore, an existing pose estimation algorithm is optimized for Xilinx High Level Synthesis (HLS). The resulting hardware acceleration cores are compared for different optimizations and, finally, we propose a hardware/software system design for a Xilinx Zynq Zedboard. Using this method, we achieve a speedup of 1.6 in comparison to a software solution on the ARM processor and, thus, facilitate hand tracking for embedded systems with low power consumption.

[1]  Dan Gazebo Sebagai,et al.  Robot Operating System (ROS) , 2020, Studies in Computational Intelligence.

[2]  Ling Shao,et al.  Enhanced Computer Vision With Microsoft Kinect Sensor: A Review , 2013, IEEE Transactions on Cybernetics.

[3]  João M. P. Cardoso,et al.  A Real Time Gesture Recognition System for Mobile Robots , 2004, ICINCO.

[4]  Kris Gaj,et al.  Can high-level synthesis compete against a hand-written code in the cryptographic domain? A case study , 2014, 2014 International Conference on ReConFigurable Computing and FPGAs (ReConFig14).

[5]  Mohamed Abid,et al.  System level synthesis of dataflow programs: HEVC decoder case study , 2013, Proceedings of the 2013 Electronic System Level Synthesis Conference (ESLsyn).

[6]  F. Althoff,et al.  ROBUST MULTIMODAL HAND-AND HEAD GESTURE RECOGNITION FOR CONTROLLING AUTOMOTIVE INFOTAINMENT SYSTEMS , 2005 .

[7]  George A. Constantinides,et al.  High-level synthesis of dynamic data structures: A case study using Vivado HLS , 2013, 2013 International Conference on Field-Programmable Technology (FPT).

[8]  Kwang-Seok Hong,et al.  An implementation of an FPGA-based embedded gesture recognizer using a data glove , 2008, ICUIMC '08.

[9]  Manish Birla,et al.  Partial run-time reconfiguration of FPGA for computer vision applications , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[10]  Amit Gupta,et al.  FPGA based Real Time Human Hand Gesture Recognition System , 2012 .

[11]  Kristian Ehlers,et al.  Self-scaling Kinematic Hand Skeleton for Real-time 3D Hand-finger Pose Estimation , 2015, VISAPP.

[12]  Hakil Kim,et al.  A fast feature extraction in object recognition using parallel processing on CPU and GPU , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[13]  Shuvra S. Bhattacharyya,et al.  Computer Vision on FPGAs: Design Methodology and its Application to Gesture Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.