Improving Haptic Transparency for Uncertain Virtual Environments Using Adaptive Control and Gain-Scheduled Prediction

The realism or transparency of haptic interfaces is becoming more critical as they are applied to training in fields like minimally invasive surgery (MIS). Surgical training simulators must provide a transparent virtual environment (VE) at a high update rate. Complex, deformable, cuttable tissue models have nonlinear dynamics and are computationally expensive, making it difficult to provide sufficient update rates. The objective of this work is to improve the transparency for this type of VE by formulating the unknown nonlinear dynamics as a quasi-linear parameter varying (LPV) system and designing a predictor to provide an output at a much higher update rate. An adaptive controller based on gain-scheduled prediction is considered for a nonlinear haptic device and a nonlinear, delayed, and sampled VE. The predictor uses feedback from the more accurate but slow-updating VE to update a simplified dynamic model. The predictor is designed based on numerical solutions to a linear matrix inequality derived using Lyapunov-based methods. Experimental results demonstrate the effectiveness of the gain-scheduled predictor approach and compare it to previous work using a constant-gain predictor. The gain-scheduled predictor results in significant performance improvements compared to a haptic system without prediction, but less significant improvement compared to the constant-gain approach.

[1]  Vincent Hayward,et al.  High-fidelity passive force-reflecting virtual environments , 2005, IEEE Transactions on Robotics.

[2]  Eckehard G. Steinbach,et al.  On the Transparency of Client/Server-Based Haptic Interaction with Deformable Objects , 2017, IEEE Transactions on Haptics.

[3]  Herve Delingette,et al.  Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation , 1999, IEEE Trans. Vis. Comput. Graph..

[4]  Frank Tendick,et al.  Multirate simulation for high fidelity haptic interaction with deformable objects in virtual environments , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[5]  Jan Swevers,et al.  On-line identification of contact dynamics in the presence of geometric uncertainties , 2008, 2008 IEEE International Conference on Robotics and Automation.

[6]  Eckehard G. Steinbach,et al.  Model-Mediated Teleoperation: Toward Stable and Transparent Teleoperation Systems , 2016, IEEE Access.

[7]  J. Edward Colgate,et al.  Passivity of a class of sampled-data systems: Application to haptic interfaces , 1997, J. Field Robotics.

[8]  Shahin Sirouspour,et al.  Adaptive Control for Improved Transparency in Haptic Simulations , 2009, IEEE Transactions on Haptics.

[9]  Martin Kraus,et al.  Simulation of surgical cutting in deformable bodies using a game engine , 2015, 2014 International Conference on Computer Graphics Theory and Applications (GRAPP).

[10]  Mariano Alcañiz Raya,et al.  Real-time deformable models for surgery simulation: a survey , 2005, Comput. Methods Programs Biomed..

[11]  Paolo Fiorini,et al.  A unified representation to interact with simulated deformable objects in virtual environments , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Xiaojun Shen,et al.  Motion and Force Prediction in Haptic Media , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[13]  Yang Shi,et al.  Transparent Virtual Coupler Design for Networked Haptic Systems With a Mixed Virtual Wall , 2012, IEEE/ASME Transactions on Mechatronics.

[14]  John Kenneth Salisbury,et al.  Stability of Haptic Rendering: Discretization, Quantization, Time Delay, and Coulomb Effects , 2006, IEEE Transactions on Robotics.

[15]  Elena Panteley,et al.  Advanced Topics in Control Systems Theory , 2005 .

[16]  Eckehard G. Steinbach,et al.  Hybrid signal-based and geometry-based prediction for haptic data reduction , 2011, 2011 IEEE International Workshop on Haptic Audio Visual Environments and Games.

[17]  Pengwen Xiong,et al.  Visual-Haptic Aid Teleoperation Based on 3-D Environment Modeling and Updating , 2016, IEEE Transactions on Industrial Electronics.

[18]  Li Huijun,et al.  Virtual-Environment Modeling and Correction for Force-Reflecting Teleoperation With Time Delay , 2007 .

[19]  A. Breda,et al.  Virtual Reality Simulators for Robot-assisted Surgery. , 2016, European urology.

[20]  Said Mammar,et al.  A Smith-prediction based haptic feedback controller for time delayed virtual environments systems , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[21]  Costas S. Tzafestas,et al.  Adaptive impedance control in haptic teleoperation to improve transparency under time-delay , 2008, 2008 IEEE International Conference on Robotics and Automation.

[22]  Shane Forbrigger,et al.  Improved Transparency for Haptic Systems with Complex Environments , 2017 .

[23]  Hendrik Van Brussel,et al.  Towards Multi-DOF model mediated teleoperation: Using vision to augment feedback , 2012, 2012 IEEE International Workshop on Haptic Audio Visual Environments and Games (HAVE 2012) Proceedings.

[24]  Olga Sourina,et al.  A Prediction Method Using Interpolation for Smooth Six-DOF Haptic Rendering in Multirate Simulation , 2013, 2013 International Conference on Cyberworlds.

[25]  Lynette A. Jones,et al.  Application of Psychophysical Techniques to Haptic Research , 2013, IEEE Transactions on Haptics.

[26]  Probal Mitra,et al.  Model-mediated Telemanipulation , 2008, Int. J. Robotics Res..

[27]  Shane Forbrigger Prediction-Based Haptic Interfaces to Improve Transparency for Complex Virtual Environments , 2017 .

[28]  Eckehard G. Steinbach,et al.  Point Cloud-Based Model-Mediated Teleoperation With Dynamic and Perception-Based Model Updating , 2014, IEEE Transactions on Instrumentation and Measurement.

[29]  Anatole Lécuyer,et al.  Enhancing Audiovisual Experience with Haptic Feedback: A Survey on HAV , 2013, IEEE Transactions on Haptics.