Improved bilateral teleoperation with proactive haptic sensing and transmission

This article presents a novel master-slave control configuration that is experimentally demonstrated to improve teleoperation performance under random network delay. This is achieved via the design of a proactive haptic sensing system based on a laser range sensor on the slave side, which in turn allows for the proactive transmission of force control from the master to the slave, thus compensating for Internet-based network delays. The proposed configuration introduces three main contributions to the literature of bilateral control systems: (1) fully decoupled position and force control systems, which allow for the controller gains of each loop to be tuned independently, eliminating the trade-off common to most previous literature; (2) a novel approach that exploits the slow variation nature of the environment parameters, resulting in a lower bandwidth requirement in comparison to previous force control methods; (3) capability to measure the slave environment location and the prediction of the contact force as a result, which provides the human operator with the capability to generate the reaction force proactively on the master side. The conducted experiments demonstrated a significantly improved performance in terms of synchronized forces and positions despite the random network delay between the master and slave systems.

[1]  Bertrand Tondu,et al.  Artificial Muscles for Humanoid Robots , 2007 .

[2]  Marcia Kilchenman O'Malley,et al.  Compensating position drift in Time Domain Passivity Approach based teleoperation , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[3]  Min Li,et al.  Intra-operative tumour localisation in robot-assisted minimally invasive surgery : a review , 2015 .

[4]  Arthur Gelb,et al.  Multiple-Input Describing Functions and Nonlinear System Design , 1968 .

[5]  Daisuke Yashiro,et al.  Performance Analysis of Bilateral Control System With Communication Bandwidth Constraint , 2011, IEEE Transactions on Industrial Electronics.

[6]  Toshiyuki Murakami,et al.  Torque sensorless control in multidegree-of-freedom manipulator , 1993, IEEE Trans. Ind. Electron..

[7]  Ljubi sa S. Draganovi,et al.  A NEW SMITH PREDICTOR FOR CONTROLLING A PROCESS WITH AN INTEGRATOR AND LONG DEAD-TIME : DESIGN AND TUNING , 2022 .

[8]  Charles R Wilson Essentials of Bone Densitometry for the Medical Physicist , 2003 .

[9]  Inna Sharf,et al.  Contact Stiffness and Damping Estimation for Robotic Systems , 2003, Int. J. Robotics Res..

[10]  K. Ohnishi,et al.  Robust bilateral control with Internet communication , 2004, 30th Annual Conference of IEEE Industrial Electronics Society, 2004. IECON 2004.

[11]  Takeshi Miura,et al.  A speed control method of small DC motor through IP network considering packet loss , 2007 .

[12]  Kouhei Ohnishi,et al.  Frequency-Domain Damping Design for Time-Delayed Bilateral Teleoperation System Based on Modal Space Analysis , 2013, IEEE Transactions on Industrial Electronics.

[13]  M. Buss,et al.  Techniques for environment parameter estimation during telemanipulation , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[14]  Schahram Dustdar,et al.  Principles for Engineering IoT Cloud Systems , 2015, IEEE Cloud Computing.

[15]  久保 亮吾,et al.  Analysis of a three-channel control architecture for bilateral teleoperation with time delay (産業計測制御研究会 計測・センサ応用,モーションコントロール全般) , 2007 .

[16]  O. J. M. Smith,et al.  A controller to overcome dead time , 1959 .

[17]  Kouhei Ohnishi,et al.  Time-Delay Compensation by Communication Disturbance Observer for Bilateral Teleoperation Under Time-Varying Delay , 2010, IEEE Transactions on Industrial Electronics.

[18]  Lucio Tommaso De Paolis,et al.  Stereoscopic Visualization and 3-D Technologies in Medical Endoscopic Teleoperation , 2015, IEEE Transactions on Industrial Electronics.

[19]  Takahiro Nozaki,et al.  Heartbeat Synchronization With Haptic Feedback for Telesurgical Robot , 2014, IEEE Transactions on Industrial Electronics.

[20]  H Lopez,et al.  Ultrasound interactions with free silicone in a tissue‐mimicking phantom. , 1998, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[21]  Metin Gokasan,et al.  Control and measurement delay compensation in bilateral position control , 2011, 2011 IEEE International Conference on Mechatronics.

[22]  Markus Wilde,et al.  Effects of Multivantage Point Systems on the Teleoperation of Spacecraft Docking , 2014, IEEE Transactions on Human-Machine Systems.

[23]  K. Ohnishi,et al.  Wireless Haptic Communication Under Varying Delay by Switching-Channel Bilateral Control With Energy Monitor , 2012, IEEE/ASME Transactions on Mechatronics.

[24]  Metin Gokasan,et al.  Network in the loop platform for research and training in bilateral control , 2012, 2012 12th IEEE International Workshop on Advanced Motion Control (AMC).

[25]  S. Munir,et al.  Wave-based teleoperation with prediction , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[26]  Asif Sabanovic,et al.  Experimental Evaluation of Novel Master-Slave Configurations for Position Control under Random Network Delay and Variable Load for Teleoperation , 2014 .

[27]  Stefano Stramigioli,et al.  Contact impedance estimation for robotic systems , 2005, IEEE Trans. Robotics.

[28]  K. Natori,et al.  Analysis and Design of Time Delayed Control Systems with Communication Disturbance Observer , 2007, 2007 IEEE International Symposium on Industrial Electronics.

[29]  Rainer Staudenmaier,et al.  Engineering of vascularized adipose constructs , 2011, Cell and Tissue Research.

[30]  Kouhei Ohnishi,et al.  Bilateral robot system on the real time network structure , 2002, 7th International Workshop on Advanced Motion Control. Proceedings (Cat. No.02TH8623).

[31]  Keyvan Hashtrudi-Zaad,et al.  Predictive Teleoperation using Laser Rangefinder , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[32]  Claudio Melchiorri,et al.  Control schemes for teleoperation with time delay: A comparative study , 2002, Robotics Auton. Syst..

[33]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[34]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[35]  Kouhei Ohnishi,et al.  A Design Method of Communication Disturbance Observer for Time-Delay Compensation, Taking the Dynamic Property of Network Disturbance Into Account , 2008, IEEE Transactions on Industrial Electronics.