Interconnecting Haptic Interfaces with High Update Rates through the Internet

Real-time transferring of the haptic sense over the Internet is quite a challenging task. This paper outlines the proposed protocols for transferring haptic streams over the Internet. Moreover, it describes the Quality of Service requirements that a network has to fulfill in order to successfully use haptic interfaces with high update rates over the Internet. Extensive simulations and experiments for the performance evaluation of transport protocols for real-time transferring haptic data are carried out. Complements between simulation and real world experiments are discussed. The metrics that are measured for the performance evaluation are delay, jitter, throughput, efficiency, packet loss and one proposed by the authors, packet arrival deviation. The simulation tests reveal which protocols could be used for the transfer of real-time haptic data over the Internet.

[1]  Yutaka Ishibashi,et al.  Performance evaluation of transport protocols for real-time supermedia — HEVC streams over the Internet , 2017, 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[2]  Y. Ishibashi,et al.  Efficient algorithm for transferring a real-time HEVC stream with haptic data through the internet , 2016, Journal of Real-Time Image Processing.

[3]  Kostas E. Psannis,et al.  Real time Haptic data transferring , 2016, 2016 Wireless Days (WD).

[4]  Seiichiro Katsura,et al.  Multi-DOF Motion Reproduction Using Motion-Copying System With Velocity Constraint , 2014, IEEE Transactions on Industrial Electronics.

[5]  Takahiro Nozaki,et al.  Heartbeat Synchronization With Haptic Feedback for Telesurgical Robot , 2014, IEEE Transactions on Industrial Electronics.

[6]  Anatole Lécuyer,et al.  Toward Haptic Cinematography: Enhancing Movie Experiences with Camera-Based Haptic Effects , 2014, IEEE MultiMedia.

[7]  Yutaka Ishibashi,et al.  QoE assessment of will transmission using haptics: Influence of network delay , 2013, 2013 IEEE 2nd Global Conference on Consumer Electronics (GCCE).

[8]  Iain Murray,et al.  Developing methodologies for the presentation of graphical educational material in a non-visual form for use by people with vision impairment , 2013, Proceedings of 2013 IEEE International Conference on Teaching, Assessment and Learning for Engineering (TALE).

[9]  Kalevi Hyyppä,et al.  Obstacle avoidance using haptics and a laser rangefinder , 2013, 2013 IEEE Workshop on Advanced Robotics and its Social Impacts.

[10]  Purang Abolmaesumi,et al.  An Augmented Reality Haptic Training Simulator for Spinal Needle Procedures , 2013, IEEE Transactions on Biomedical Engineering.

[11]  Abdulmotaleb El-Saddik,et al.  Toward a Mathematical Model for Quality of Experience Evaluation of Haptic Applications , 2013, IEEE Transactions on Instrumentation and Measurement.

[12]  Seiichiro Katsura,et al.  Design of force compensator with variable gain for bilateral control system under time delay , 2013, 2013 IEEE International Symposium on Industrial Electronics.

[13]  S. Katsura,et al.  Evaluation of QoS in haptic communication based on bilateral control , 2013, 2013 IEEE International Conference on Mechatronics (ICM).

[14]  Shuji Tasaka,et al.  A multidimensional QoE monitoring system for audiovisual and haptic interactive IP communications , 2013, 2013 IEEE 10th Consumer Communications and Networking Conference (CCNC).

[15]  Frank Drews,et al.  A video game controller with skin stretch haptic feedback , 2013, 2013 IEEE International Conference on Consumer Electronics (ICCE).

[16]  Abdulmotaleb El-Saddik,et al.  The HTML5 Haptics Plugin , 2012, 2012 IEEE International Workshop on Haptic Audio Visual Environments and Games (HAVE 2012) Proceedings.

[17]  Takeshi Ando,et al.  A Haptic Interface “Force Blinker 2” for Navigation of the Visually Impaired , 2012, IEEE Transactions on Industrial Electronics.

[18]  Sandra Hirche,et al.  Human-Oriented Control for Haptic Teleoperation , 2012, Proceedings of the IEEE.

[19]  Abu Saleh Md. Mahfujur Rahman,et al.  Measurements of Multimodal Approach to Haptic Interaction in Second Life Interpersonal Communication System , 2011, IEEE Transactions on Instrumentation and Measurement.

[20]  Jiri Filipovic,et al.  Distributed Construction of Configuration Spaces for Real-Time Haptic Deformation Modeling , 2011, IEEE Transactions on Industrial Electronics.

[21]  Shuji Hashimoto,et al.  Haptic Sensing Foot System for Humanoid Robot and Ground Recognition With One-Leg Balance , 2011, IEEE Transactions on Industrial Electronics.

[22]  Milos Manic,et al.  Self-Organizing Fuzzy Haptic Teleoperation of Mobile Robot Using Sparse Sonar Data , 2011, IEEE Transactions on Industrial Electronics.

[23]  Kouhei Ohnishi,et al.  Multi-DOF Micro-Macro Bilateral Controller Using Oblique Coordinate Control , 2011, IEEE Transactions on Industrial Informatics.

[24]  Linda R. Elliott,et al.  Development of Tactile and Haptic Systems for U.S. Infantry Navigation and Communication , 2011, HCI.

[25]  M. Mellia,et al.  Experiences of Internet traffic monitoring with tstat , 2011, IEEE Network.

[26]  Yutaka Ishibashi,et al.  QoE assessment in haptic media, sound, and video transmission: Effect of playout buffering control , 2010, CIE.

[27]  Kouhei Ohnishi,et al.  Stable and Transparent Time-Delayed Teleoperation by Direct Acceleration Waves , 2010, IEEE Transactions on Industrial Electronics.

[28]  Farnam Jahanian,et al.  Internet inter-domain traffic , 2010, SIGCOMM '10.

[29]  Yoichi Hori,et al.  A New Control Method for Power-Assisted Wheelchair Based on the Surface Myoelectric Signal , 2010, IEEE Transactions on Industrial Electronics.

[30]  Shuji Hashimoto,et al.  Robotic Tactile Sensor System and Applications , 2010, IEEE Transactions on Industrial Electronics.

[31]  Judith Kelner,et al.  A Survey on Internet Traffic Identification , 2009, IEEE Communications Surveys & Tutorials.

[32]  Raul Wirz,et al.  Bidirectional Transport Protocol for Teleoperated Robots , 2009, IEEE Transactions on Industrial Electronics.

[33]  Raul Wirz,et al.  Efficient Transport Protocol for Networked Haptics Applications , 2008, EuroHaptics.

[34]  Kouhei Ohnishi,et al.  A Design Method of Communication Disturbance Observer for Time-Delay Compensation, Taking the Dynamic Property of Network Disturbance Into Account , 2008, IEEE Transactions on Industrial Electronics.

[35]  A. El Saddik,et al.  ALPHAN: Application Layer Protocol for HAptic Networking , 2007, 2007 IEEE International Workshop on Haptic, Audio and Visual Environments and Games.

[36]  Kwee-Bo Sim,et al.  Internet-Based Teleoperation of an Intelligent Robot With Optimal Two-Layer Fuzzy Controller , 2006, IEEE Transactions on Industrial Electronics.

[37]  Michele C. Weigle,et al.  Tmix: a tool for generating realistic TCP application workloads in ns-2 , 2006, CCRV.

[38]  Eddie Kohler,et al.  RFC 4340: Datagram Congestion Control Protocol (DCCP) , 2006 .

[39]  Raul Wirz,et al.  A multimodal interface to control a robot arm via the web: a case study on remote programming , 2005, IEEE Transactions on Industrial Electronics.

[40]  Ning Xi,et al.  Supermedia Transport for Teleoperations over Overlay Networks , 2005, NETWORKING.

[41]  Li Ping,et al.  Transport layer protocol reconfiguration for network-based robot control system , 2005, Proceedings. 2005 IEEE Networking, Sensing and Control, 2005..

[42]  Yutaka Uchimura,et al.  Bilateral robot system on the real-time network structure , 2004, IEEE Transactions on Industrial Electronics.

[43]  Jin Cao,et al.  Stochastic models for generating synthetic HTTP source traffic , 2004, IEEE INFOCOM 2004.

[44]  Mikio Hasegawa,et al.  An analysis of the Internet traffic by the method of surrogate data , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[45]  Martin Mauve,et al.  RTP/I-toward a common application level protocol for distributed interactive media , 2001, IEEE Trans. Multim..

[46]  Yasir Saleem,et al.  Network Simulator NS-2 , 2015 .

[47]  Takahiro Nozaki,et al.  Decoupling Strategy for Position and Force Control Based on Modal Space Disturbance Observer , 2014, IEEE Transactions on Industrial Electronics.

[48]  Takahiro Nozaki,et al.  Stiffness Transmission of Scaling Bilateral Control System by Gyrator Element Integration , 2014, IEEE Transactions on Industrial Electronics.

[49]  Abdulmotaleb El-Saddik,et al.  Admux: An Adaptive Multiplexer for Haptic–Audio–Visual Data Communication , 2011, IEEE Transactions on Instrumentation and Measurement.

[50]  Frank H. P. Fitzek,et al.  Video Traces for Network Performance Evaluation , 2006 .

[51]  S. hulzrinneCasnerFrederi A Transport Protocol for Real-time Applications , 2001 .

[52]  Seokhee Lee,et al.  Experiment on International Connection for Haptic Media Communications , 2022 .