Control of Cooperative Haptics-Enabled Teleoperation Systems with Application to Minimally Invasive Surgery

Robot-Assisted Minimally Invasive Surgical (RAMIS) systems frequently have a structure of cooperative teleoperator systems where multiple master-slave pairs are used to collaboratively execute a task. Although multiple studies indicate that haptic feedback improves the realism of tool-tissue interaction to the surgeon and leads to better performance for surgical procedures, current telesurgical systems typically do not provide force feedback, mainly because of the inherent stability issues. The research presented in this thesis is directed towards the development of control algorithms for force reflecting cooperative surgical teleoperator systems with improved stability and transparency characteristics. In the case of cooperative force reflecting teleoperation over networks, conventional passivitybased approaches may have limited applicability due to potentially nonpassive slave-slave interactions and irregular communication delays imposed by the network. In this thesis, an alternative small gain framework for the design of cooperative network-based force reflecting teleoperator systems is developed. Using the small gain framework, control algorithms for cooperative force-reflecting teleoperator systems are designed that guarantee stability in the presence of multiple network-induced communication constraints. Furthermore, the design conservatism typically associated with the small-gain approach is eliminated by using the Projection-Based Force Reflection (PBFR) algorithms. Stability results are established for networked cooperative teleoperator systems under different types of force reflection algorithms in the presence of irregular communication delays. The proposed control approach is consequently implemented on a dual-arm (two masters/two slaves) robotic MIS testbed. The testbed consists of two Haptic Wand devices as masters and two PA10-7C robots as the slave manipulators equipped with da Vinci laparoscopic surgical instruments. The performance of the proposed control approach is evaluated in three different cooperative surgical tasks, which are knot tightening, pegboard transfer, and object manipulation. The experimental results obtained indicate that the PBFR algorithms demonstrate statistically significant performance improvement in comparison with the conventional direct force reflection algorithms. One possible shortcoming of using PBFR algorithms is that implementation of these algorithms may lead to attenuation of the high-frequency component of the contact force which is important, in particular, for haptic perception of stiff surfaces. In this thesis, a solution to this problem is proposed which is based on the idea of separating the different frequency bands in the force reflection signal and consequently applying the projection-based principle to the low-frequency component, while reflecting the high-frequency component directly. The experimental results demonstrate that substantial improvement in transient fidelity of the force feedback is achieved using the proposed method without negative effects on the stability of the system.

[1]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[2]  Peter Xiaoping Liu,et al.  Force reflection algorithm for improved transparency in bilateral teleoperation with communication delay , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[3]  Fabian R. Wirth,et al.  An ISS small gain theorem for general networks , 2007, Math. Control. Signals Syst..

[4]  Eduardo Sontag,et al.  On characterizations of the input-to-state stability property , 1995 .

[5]  Shahin Sirouspour,et al.  Cooperative teleoperation control with projective force mappings , 2010, 2010 IEEE Haptics Symposium.

[6]  Ilia G. Polushin,et al.  A Small Gain Framework for Networked Cooperative Teleoperation , 2010 .

[7]  Alexander L. Fradkov,et al.  Nonlinear and Adaptive Control of Complex Systems , 1999 .

[8]  Katherine J. Kuchenbecker,et al.  Induced Master Motion in Force-Reflecting Teleoperation , 2006 .

[9]  David Angeli,et al.  Input-to-state stability of PD-controlled robotic systems , 1999, Autom..

[10]  Ali Shahdi,et al.  Discrete-time multi-model control for cooperative teleoperation under time delay , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[11]  Blake Hannaford,et al.  Stability and performance tradeoffs in bi-lateral telemanipulation , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[12]  A. Teel Connections between Razumikhin-type theorems and the ISS nonlinear small gain theorem , 1998, IEEE Trans. Autom. Control..

[13]  A. Schaft,et al.  L2-Gain and Passivity in Nonlinear Control , 1999 .

[14]  Stanley A. Schneider,et al.  Object impedance control for cooperative manipulation: theory and experimental results , 1992, IEEE Trans. Robotics Autom..

[15]  Ilia G. Polushin,et al.  Control schemes for stable teleoperation with communication delay based on IOS small gain theorem , 2006, Autom..

[16]  Eduardo Sontag,et al.  On Characterizations of Input-to-State Stability with Respect to Compact Sets , 1995 .

[17]  Peter Xiaoping Liu,et al.  A multichannel IOS small gain theorem for systems with multiple time-varying communication delays , 2007, 2007 46th IEEE Conference on Decision and Control.

[18]  Ping Hsu,et al.  Control of multimanipulator systems-trajectory tracking, load distribution, internal force control, and decentralized architecture , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[19]  Rajnikant V. Patel,et al.  Small gain design of cooperative teleoperator system with projection-based force reflection , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Eduardo Sontag Smooth stabilization implies coprime factorization , 1989, IEEE Transactions on Automatic Control.

[21]  Ilya Kolmanovsky,et al.  Application of input estimation techniques to charge estimation and control in automotive engines , 2002 .

[22]  Peter Xiaoping Liu,et al.  Stability of bilateral teleoperators with projection-based force reflection algorithms , 2008, 2008 IEEE International Conference on Robotics and Automation.

[23]  Ilia G. Polushin,et al.  Human dynamics and stability of teleoperator systems with generalized projection-based force reflection algorithms , 2011 .

[24]  Eduardo Sontag Input to State Stability: Basic Concepts and Results , 2008 .

[25]  Rajnikant V. Patel,et al.  Small-gain design of networked cooperative bilateral teleoperators , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Rajnikant V. Patel,et al.  A small gain framework for networked cooperative force-reflecting teleoperation , 2013, Autom..

[27]  Neville Hogan,et al.  The mechanics of multi-joint posture and movement control , 1985, Biological Cybernetics.

[28]  Martin Buss,et al.  Model-Mediated Teleoperation for multi-operator multi-robot systems , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Claudio Melchiorri,et al.  LQ control design of cooperative teleoperation systems , 2009, 2009 International Conference on Advanced Robotics.

[30]  Shahin Sirouspour,et al.  Modeling and control of cooperative teleoperation systems , 2005, IEEE Transactions on Robotics.