A low-power SoC-based moving target detection system for amphibious spherical robots

A moving target detection and tracking system is critical important for autonomous mobile robot to accomplish complicated tasks. Aiming at application requirements of our amphibious spherical robot proposed in previous researches, a low-power and portable moving target detection system was designed and implemented in this paper. Xilinx Zynq-7000 SoC (System on Chip) was used to fabricate the image processing system of the robot for detection and tracking. An OmniVision OV7670 COMS image sensor controlled by customized IP cores in the PL (Programmable Logic) of the SoC was adopted to acquire 640×480 RGB images at 30 frames per second. The Gaussian background modeling method was implemented with Vivado HLS in the PL to detect moving targets. And a FCT (Fast Compressive Tracking) tracker with motion estimation mechanism was running in the PS (Processing System) of the SoC to track targets captured by the detection subsystem subsequently. Besides, the dynamical power management (DPM) and the dynamical voltage frequency scaling (DVFS) mechanisms were used for a higher power-efficiency. Experimental results verified the validation and performance of the detection system. The design in this paper may have reference value for vision-based mobile robots or vehicles.

[1]  Kevin Fu,et al.  Software techniques to reduce the energy consumption of low-power devices at the limits of digital abstractions , 2012 .

[2]  Matthew Berger,et al.  Subspace Tracking under Dynamic Dimensionality for Online Background Subtraction , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Han Xiao,et al.  A real-time small moving object detection system based on infrared image , 2014, 2014 IEEE International Conference on Mechatronics and Automation.

[4]  Shanq-Jang Ruan,et al.  Honeycomb Model Based Skin Color Detector for Face Detection , 2008, 2008 15th International Conference on Mechatronics and Machine Vision in Practice.

[5]  Najeem Lawal,et al.  Energy-Efficient SRAM FPGA-Based Wireless Vision Sensor Node: SENTIOF-CAM , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Shuxiang Guo,et al.  Development of an amphibious mother spherical robot used as the carrier for underwater microrobots , 2012, 2012 ICME International Conference on Complex Medical Engineering (CME).

[7]  Antonio Cenedese,et al.  Using optical flow equation for particle detection and velocity prediction in particle tracking , 2012, Appl. Math. Comput..

[8]  Chong-Wah Ngo,et al.  Flip-Invariant SIFT for Copy and Object Detection , 2013, IEEE Transactions on Image Processing.

[9]  Waseem Ahmed,et al.  Pointing and target selection of object using color detection algorithm through DSP processor TMS320C6711 , 2011, 2011 International Conference on Information and Communication Technologies.

[10]  Michael Hübner,et al.  Dynamic and partial reconfiguration of Zynq 7000 under Linux , 2013, 2013 International Conference on Reconfigurable Computing and FPGAs (ReConFig).

[11]  Sébastien Briot,et al.  A method for simplifying the analysis of leg-based visual servoing of parallel robots , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Wang Bing-bing,et al.  Pedestrian detection based on the combination of HOG and background subtraction method , 2011, Proceedings 2011 International Conference on Transportation, Mechanical, and Electrical Engineering (TMEE).

[13]  Yao Wei.  Study of Embedded System Low-Power Software Technology , 2011 .

[14]  Abdul Imran Rasheed,et al.  FPGA implementation of blob detection algorithm for object detection in visual navigation , 2013, 2013 International conference on Circuits, Controls and Communications (CCUBE).

[15]  Hyun Myung,et al.  Vision-based object detection and tracking for autonomous navigation of underwater robots , 2012 .

[16]  Micheal Drieberg,et al.  Automated eye blink detection and tracking using template matching , 2013, 2013 IEEE Student Conference on Research and Developement.

[17]  Larry S. Davis,et al.  Shape-Based Human Detection and Segmentation via Hierarchical Part-Template Matching , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  J. Duhamel,et al.  A real-time 3D video tracking system for monitoring primate groups , 2014, Journal of Neuroscience Methods.

[19]  A. Kazlouski,et al.  Plain objects detection in image based on a contour tracing algorithm in a binary image , 2014, 2014 IEEE International Symposium on Innovations in Intelligent Systems and Applications (INISTA) Proceedings.

[20]  Jiande Wu,et al.  Research on moving target detection algorithm based on MRA and wavelet threshold , 2014, The 26th Chinese Control and Decision Conference (2014 CCDC).

[21]  Heiko Neumann,et al.  Robot navigation by combining central and peripheral optical flow detection on a space-variant map , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[22]  Saeed Mirghasemi,et al.  Sea target detection based on SVM method using HSV color space , 2009, 2009 IEEE Student Conference on Research and Development (SCOReD).

[23]  Erdal Oruklu,et al.  3D image reconstruction and human body tracking using stereo vision and Kinect technology , 2012, 2012 IEEE International Conference on Electro/Information Technology.

[24]  A. Shashua,et al.  Pedestrian detection for driving assistance systems: single-frame classification and system level performance , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[25]  Lei Zhang,et al.  Fast Compressive Tracking , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Hassen Mekki,et al.  Path planning for 3D visual servoing: For a wheeled mobile robot , 2013, 2013 International Conference on Individual and Collective Behaviors in Robotics (ICBR).

[27]  Shuxiang Guo,et al.  A Kinect-Based Real-Time Compressive Tracking Prototype System for Amphibious Spherical Robots , 2015, Sensors.

[28]  Shuxiang Guo,et al.  A spherical robot based on all programmable SoC and 3-D printing , 2014, 2014 IEEE International Conference on Mechatronics and Automation.