ViMediaNet: an emulation system for interactive multimedia based telepresence services

The telepresence service (TPS) leverages advanced communication, virtual reality, and cooperative web technologies to provide remote engaged users an immersive experience of being fully present, which are widely used in teleconferencing, remote surgery, and hazardous environment exploration. The common feature of TPS-based applications lies in that the users’ experiences heavily depend on the quality of interactive multimedia services, that is, most deliveries of multimedia contents are mission-critical, as well as time-critical, to ensure the control and operation accuracy for telerobots. Therefore, the delivery performance of multimedia contents over heterogeneous networks becomes the primary concern in the TPS system design, especially for those delay sensitive applications, like remote surgery and environment exploration. In this paper, we incorporate video processing tools with the network simulator to design and implement a joint emulation system, named as the virtual media network (ViMediaNet), through which, the TPS designer can readily deploy the TPS system over a heterogeneous network virtualized by the network emulator, investigate the critical network performance metrics in the multimedia content delivery, such as transmission delay and packet jitter, and observe control results in real time. To verify the capability of ViMediaNet in emulating the real-setting TPS system, we take a mobile device based vision navigation system as an example to evaluate performance impacts of the rate adaptation technology in the telerobot control. The experimental results reveal that the adaptive video streaming is a promising solution to significantly enhance the control accuracy of telerobots in TPS systems.

[1]  Katherine M. Tsui,et al.  Towards measuring the quality of interaction: communication through telepresence robots , 2012, PerMIS.

[2]  Zhen Li,et al.  HARDWARE-IN-THE-LOOP SIMULATION , 2004 .

[3]  Keith W. Ross,et al.  Computer networking - a top-down approach featuring the internet , 2000 .

[4]  David B. Kaber,et al.  Telepresence , 1998, Hum. Factors.

[5]  Silvia Coradeschi,et al.  A Review of Mobile Robotic Telepresence , 2013, Adv. Hum. Comput. Interact..

[6]  G. Ballantyne Robotic surgery, telerobotic surgery, telepresence, and telementoring , 2002, Surgical Endoscopy And Other Interventional Techniques.

[7]  Ragnhild Eg,et al.  Adaptive Media Streaming to Mobile Devices: Challenges, Enhancements, and Recommendations , 2014, Adv. Multim..

[8]  M. Bacic,et al.  On hardware-in-the-loop simulation , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[9]  H. Schulzrinne,et al.  A Transport Protocol for Real-time Applications , 2010 .

[10]  Philippe Jacquet,et al.  Optimized Link State Routing Protocol (OLSR) , 2003, RFC.

[11]  Oliver Schreer,et al.  An immersive 3D video-conferencing system using shared virtual team user environments , 2002, CVE '02.

[12]  Brian Rivera,et al.  Mobile Ad Hoc Network emulation environment , 2009, MILCOM 2009 - 2009 IEEE Military Communications Conference.

[13]  Carol R. Stoker,et al.  Antarctic Undersea Exploration Using a Robotic Submarine with a Telepresence User Interface , 1995, IEEE Expert.

[14]  Mario Cifrek,et al.  A brief introduction to OpenCV , 2012, 2012 Proceedings of the 35th International Convention MIPRO.

[15]  Takashi Minato,et al.  Telenoid: tele-presence android for communication , 2011, SIGGRAPH '11.

[16]  Katherine M. Tsui,et al.  Exploring use cases for telepresence robots , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[17]  Jodi Forlizzi,et al.  Designing interfaces for multi-user, multi-robot systems , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[18]  Alka Pandey,et al.  Analysis of Packet Dropping Algorithm in Optimized Link State Routing Protocol (OLSR) in MANET , 2016 .

[19]  J. Marescaux,et al.  Transcontinental Robot-Assisted Remote Telesurgery: Feasibility and Potential Applications , 2002, Annals of surgery.

[20]  Katherine M. Tsui,et al.  Iterative design of a semi-autonomous social telepresence robot research platform: a chronology , 2014, Intell. Serv. Robotics.

[21]  José Santos-Victor,et al.  Vision-based navigation and environmental representations with an omnidirectional camera , 2000, IEEE Trans. Robotics Autom..