A framework of networked visual servo control system with distributed computation

In this paper, a networked visual servo control system with distributed computation is proposed to overcome the low sampling rate problem in vision-based control systems. A real-time image data transmission protocol based on Realtime Transport Protocol (RTP) is developed. The captured images are sent to different processing nodes connected over a communication network and processed in parallel. Thus, a high sampling rate of the visual feedback is achieved under a cloud image processing architecture. The varying image processing delay caused by the varying number of extracted features and the random transmission delay are modeled as a random process with Bernoulli distribution. By using the input-delay approach, the resulted networked visual servo control system is reformulated into a stochastic continuous-time system with time-varying delay. Experiments on two 1-DoF linear motor modules are carried out to validate the proposed approach. A visual servo control system without parallel distributed computation is implemented for comparison. The experimental results demonstrate significant performance improvement by the proposed approach.

[1]  William J. Wilson,et al.  Relative end-effector control using Cartesian position based visual servoing , 1996, IEEE Trans. Robotics Autom..

[2]  Vaidy S. Sunderam,et al.  PVM: A Framework for Parallel Distributed Computing , 1990, Concurr. Pract. Exp..

[3]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[4]  Enric Cervera.  Distributed visual servoing: a cross-platform agent-based implementation , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Peter Corke,et al.  High-Performance Visual Closed-Loop Robot Control , 1994 .

[6]  Rajkumar Buyya,et al.  High Performance Cluster Computing , 1999 .

[7]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[8]  Sandra Hirche,et al.  A switching control law for a networked visual servo control system , 2010, 2010 IEEE International Conference on Robotics and Automation.

[9]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[10]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[11]  Huijun Gao,et al.  Robust sampled-data H∞ control with stochastic sampling , 2009, Autom..

[12]  Lee D. Davisson,et al.  An Introduction To Statistical Signal Processing , 2004 .

[13]  Jacques Gangloff,et al.  High-speed visual servoing of a 6-d.o.f. manipulator using multivariable predictive control , 2003, Adv. Robotics.

[14]  Avinash C. Kak,et al.  A subsumptive, hierarchical, and distributed vision-based architecture for smart robotics , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Markus Vincze,et al.  Dynamics and system performance of visual servoing , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[16]  Rafael Kelly,et al.  Stable visual servoing of camera-in-hand robotic systems , 2000 .

[17]  Rajkumar Buyya,et al.  High Performance Cluster Computing: Architectures and Systems , 1999 .

[18]  Yoshiro Imai,et al.  Development of a high-speed multifingered hand system and its application to catching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[19]  Éric Marchand,et al.  Virtual Visual Servoing: a framework for real‐time augmented reality , 2002, Comput. Graph. Forum.