Performance-oriented networked visual servo control with sending rate scheduling

In order to speed up image processing in visual servoing, the distributed computational power across networks and appropriate data transmission mechanisms are of particular interest. In this paper, a high sampling rate of visual feedback is achieved by distributed computation on a cloud image processing platform. For target tracking with a networked visual servo control system, a switching control law considering the varying feedback delay caused by image processing and data transmission is applied to improve the control performance. A sending rate scheduling strategy aiming at saving the network load is proposed based on the tracking error. Experiments on a 7 degree-of-freedom (DoF) manipulator are carried out to validate the proposed approach. The proposed approach shows a similar control performance as a system without sending rate scheduling, however, beneficially with largely reduced network load.

[1]  Peter I. Corke,et al.  Dynamic effects in visual closed-loop systems , 1996, IEEE Trans. Robotics Autom..

[2]  Tingting Xu,et al.  A high-speed multi-GPU implementation of bottom-up attention using CUDA , 2009, 2009 IEEE International Conference on Robotics and Automation.

[3]  Mounir Hamdi,et al.  Parallel Image Processing Applications on a Network of Workstations , 1995, Parallel Comput..

[4]  Bartlomiej Stanczyk.  Development and Control of an Anthropomorphic Telerobotic System , 2006 .

[5]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[6]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[7]  Rajkumar Buyya,et al.  High Performance Cluster Computing: Architectures and Systems , 1999 .

[8]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[9]  Sandra Hirche,et al.  A switching control law for a networked visual servo control system , 2010, 2010 IEEE International Conference on Robotics and Automation.

[10]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[11]  Koichi Hashimoto,et al.  Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback , 1993 .

[12]  Bharadwaj Veeravalli,et al.  Distributed Image Processing On A Network Of Workstations , 2003 .

[13]  Tieniu Tan,et al.  A survey on visual surveillance of object motion and behaviors , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  Yakup Genc,et al.  GPU-based Video Feature Tracking And Matching , 2006 .

[15]  Karl Johan Åström,et al.  Adaptive Control , 1989, Embedded Digital Control with Microcontrollers.

[16]  Sandra Hirche,et al.  Distributed computation and data scheduling for networked visual servo control systems , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Vaidy S. Sunderam,et al.  PVM: A Framework for Parallel Distributed Computing , 1990, Concurr. Pract. Exp..

[18]  Mubarak Shah,et al.  Tracking and Object Classification for Automated Surveillance , 2002, ECCV.

[19]  P. J. Narayanan,et al.  CUDA cuts: Fast graph cuts on the GPU , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.