Robot vision application on embedded vision implementation with digital signal processor

The great development of robot vision represented by deep learning places urgent demands on embedded vision implementation. This article introduces a hardware framework for implementation of embedded vision based on digital signal processor, which can be widely used in robot vision applications. Firstly, the article discusses implementation of a pretrained typical convolutional neural network on the digital signal processor embedded system for real-time handwritten digit recognition. Then, the article introduces the migration of OpenCV software packages to digital signal processor embedded system and the implementation flow of face detection algorithms with OpenCV on digital signal processor. The experimental results are remarkable with convolutional neural networks for handwritten digit recognition. This article provides a convenient and feasible design scheme of digital signal processor system for implementation of embedded vision.

[1]  P. Phalguni,et al.  Design and implementation of an automatic traffic sign recognition system on TI OMAP-L138 , 2013, 2013 IEEE International Conference on Industrial Technology (ICIT).

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Jingbo Chen,et al.  Spatiotemporal Saliency Detection Based on Maximum Consistency Superpixels Merging for Video Analysis , 2020, IEEE Transactions on Industrial Informatics.

[4]  Liu Shijian Design of Real-time Infrared Signal Processing System Based on TMS320C6748 and SYS/BOIS , 2012 .

[5]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[7]  Rahul Prabhu,et al.  Overcoming the Challenges of Porting OpenCV to TI's Embedded ARM + DSP Platforms , 2012 .

[8]  Qiang Wu,et al.  Research on the High-Speed Image Acquisition and Storage Technology based on TMS320C6748 , 2016 .

[9]  Jianwei Zhang,et al.  Discover Novel Visual Categories From Dynamic Hierarchies Using Multimodal Attributes , 2013, IEEE Transactions on Industrial Informatics.

[10]  Zhigang Liu,et al.  An Efficient DSP–FPGA-Based Implementation of Hybrid PWM for Electric Rail Traction Induction Motor Control , 2018, IEEE Transactions on Power Electronics.

[11]  Yogita Dubey,et al.  Implementation of brain MR image segmentation algorithm on DSP , 2017, 2017 International Conference on Communication and Signal Processing (ICCSP).

[12]  Qichao Wang,et al.  Hierarchical Topic Model Based Object Association for Semantic SLAM , 2019, IEEE Transactions on Visualization and Computer Graphics.

[13]  Lei Li,et al.  Design of video aerial target detection and tracking system based on AM5728 , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[14]  Shengyong Chen,et al.  Intelligent Collaborative Localization Among Air-Ground Robots for Industrial Environment Perception , 2019, IEEE Transactions on Industrial Electronics.

[15]  Zoubir Hamici,et al.  Power Conditioning With Intelligent Control Using a Novel Recursive Stochastic Optimization , 2019, IEEE Transactions on Industrial Electronics.

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.