Energy Prediction for Teleoperation Systems That Combine the Time Domain Passivity Approach with Perceptual Deadband-Based Haptic Data Reduction

We study the combination of the perceptual deadband (PD)-based haptic packet rate reduction scheme with the time domain passivity approach (TDPA) for time-delayed teleoperation and propose a novel energy prediction (EP) scheme that deals with the conservative behavior of the resulting controller. The PD approach leads to irregular packet transmission, resulting in degraded system transparency and reduced teleoperation quality when the PD approach is combined with the TDPA. The proposed method (PD+TDPA+EP) adaptively predicts the system energy during communication interruptions and allows for larger energy output. This achieves less conservative control and improves the teleoperation quality. Evaluation of the displayed impedance shows that the PD+TDPA+EP method achieves improved system transparency, both objectively and subjectively, when compared with related approaches from literature. According to a subjective user study, the PD+TDPA+EP method allows for a high packet rate reduction (up to 80 percent) without noticeably distorting the perceived interaction quality. We also show that the PD+TDPA+EP method is preferred over related approaches from literature in a direct comparison test. Thus, with the proposed PD+TDPA+EP method, a high data reduction and a high teleoperation quality are simultaneously achieved for time-delayed teleoperation.

[1]  Astrid M. L. Kappers,et al.  Cues for Haptic Perception of Compliance , 2009, IEEE Transactions on Haptics.

[2]  John Kenneth Salisbury,et al.  The Intuitive/sup TM/ telesurgery system: overview and application , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[3]  Jean-Jacques E. Slotine,et al.  Stable Adaptive Teleoperation , 1990, 1990 American Control Conference.

[4]  Sandra Hirche,et al.  Haptic Communications , 2012, Proceedings of the IEEE.

[5]  J. Edward Colgate,et al.  Factors affecting the Z-Width of a haptic display , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[6]  Dale A. Lawrence Stability and transparency in bilateral teleoperation , 1993, IEEE Trans. Robotics Autom..

[7]  Claudio Pacchierotti,et al.  Improving transparency in passive teleoperation by combining cutaneous and kinesthetic force feedback , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Sandra Hirche,et al.  Transparent Data Reduction in Networked Telepresence and Teleaction Systems. Part I: Communication without Time Delay , 2007, PRESENCE: Teleoperators and Virtual Environments.

[9]  Stefano Stramigioli,et al.  Bilateral Telemanipulation With Time Delays: A Two-Layer Approach Combining Passivity and Transparency , 2011, IEEE Transactions on Robotics.

[10]  N. Durlach,et al.  Manual discrimination of force using active finger motion , 1991, Perception & psychophysics.

[11]  James Moyne,et al.  Using deadbands to reduce communication in networked control systems , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[12]  Sandra Hirche,et al.  Haptic Telepresence in Packet Switched Communication Networks , 2005 .

[13]  El Saddik,et al.  The Potential of Haptics Technologies , 2007, IEEE Instrumentation & Measurement Magazine.

[14]  Thomas B. Sheridan,et al.  Supervisory control of remote manipulation , 1967, IEEE Spectrum.

[15]  Muhammad Nabeel,et al.  Stable and transparent teleoperation over communication time-delay: Observer-based input-to-state stable approach , 2016, 2016 IEEE Haptics Symposium (HAPTICS).

[16]  Jordi Artigas,et al.  A passive bilateral control scheme for a teleoperator with time-varying communication delay , 2010 .

[17]  L. A. Jones Matching Forces: Constant Errors and Differential Thresholds , 1989, Perception.

[18]  Mahdi Tavakoli,et al.  A passivity criterion for sampled-data bilateral teleoperation systems , 2011, 2011 IEEE World Haptics Conference.

[19]  Eckehard G. Steinbach,et al.  Disposal of explosive ordnances by use of a bimanual haptic telepresence system , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[20]  Sandra Hirche,et al.  Human-Oriented Control for Haptic Teleoperation , 2012, Proceedings of the IEEE.

[21]  Hong Z. Tan,et al.  HUMAN FACTORS FOR THE DESIGN OF FORCE-REFLECTING HAPTIC INTERFACES , 1994 .

[22]  Luis F. Penin,et al.  Teleoperation with time delay: A survey and its use in space robotics , 2002 .

[23]  Ernst Heinrich Weber Die Lehre vom Tastsinne und Gemeingefühle auf Versuche gegründet , 1851 .

[24]  G. Gescheider Psychophysics: The Fundamentals , 1997 .

[25]  Angel Rubio,et al.  Stability analysis of a 1 DOF haptic interface using the Routh-Hurwitz criterion , 2004, IEEE Transactions on Control Systems Technology.

[26]  P. Hinterseer,et al.  Model based data compression for 3D virtual haptic teleinteraction , 2006, 2006 Digest of Technical Papers International Conference on Consumer Electronics.

[27]  I. Hunter,et al.  A perceptual analysis of stiffness , 2004, Experimental Brain Research.

[28]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[29]  Sandra Hirche,et al.  Perceptual coding of haptic data in time-delayed teleoperation , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[30]  Martin Buss,et al.  Control Problems in Multi-Modal Telepresence Systems , 1999 .

[31]  Dongjun Lee,et al.  Passive-Set-Position-Modulation Framework for Interactive Robotic Systems , 2010, IEEE Transactions on Robotics.

[32]  Rolf Isermann,et al.  Identification of Dynamic Systems , 2011 .

[33]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1989 .

[34]  C. Bovy,et al.  Analysis of end-to-end delay measurements in the Internet , 2002 .

[35]  Rolf Isermann,et al.  Identification of Dynamic Systems: An Introduction with Applications , 2010 .

[36]  T. Cornsweet,et al.  The staircrase-method in psychophysics. , 1962, The American journal of psychology.

[37]  Sandra Hirche,et al.  Perception-Based Data Reduction and Transmission of Haptic Data in Telepresence and Teleaction Systems , 2008, IEEE Transactions on Signal Processing.

[38]  Marcia Kilchenman O'Malley,et al.  Compensating position drift in Time Domain Passivity Approach based teleoperation , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[39]  Ya-Jun Pan,et al.  Bilateral Teleoperation With Time-Varying Delay: A Communication Channel Passification Approach , 2013, IEEE/ASME Transactions on Mechatronics.

[40]  Andre Schiele,et al.  Time Domain Passivity Controller for 4-Channel Time-Delay Bilateral Teleoperation , 2015, IEEE Transactions on Haptics.

[41]  Sandra Hirche,et al.  A novel, psychophysically motivated transmission approach for haptic data streams in telepresence and teleaction systems , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[42]  Sandra Hirche,et al.  Haptic Data Compression and Communication , 2011, IEEE Signal Processing Magazine.

[43]  Eckehard G. Steinbach,et al.  Haptic data reduction for time-delayed teleoperation using the time domain passivity approach , 2015, 2015 IEEE World Haptics Conference (WHC).

[44]  Sandra Hirche,et al.  Transparent Data Reduction in Networked Telepresence and Teleaction Systems. Part II: Time-Delayed Communication , 2007, PRESENCE: Teleoperators and Virtual Environments.

[45]  Mark W. Spong,et al.  PASSIVATION OF FORCE REFLECTING BILATERAL TELEOPERATORS WITH TIME VARYING DELAY , 2002 .