Video time lag analysis in a remote collaborative framework

The paper discusses the design and implementation of a low-cost tool for analysis and design of applications involving video based networked interaction or teleoperation, such as remotely operated devices and collaborative environments. The tool is intended for providing an accurate measure of the video lag involved in the encoding and streaming video over packet networks, and for assessing the impact that delays in the video communication has in terms of human performance. A visuomotor experiment is reported in which two subjects are requested to accomplish a remote control task by using delayed video feedback, under different delay conditions. Finally, some considerations are given on the system and on its future developments.

[1]  Robin Wolff,et al.  Comparing the End to End Latency of an Immersive Collaborative Environment and a Video Conference , 2009, 2009 13th IEEE/ACM International Symposium on Distributed Simulation and Real Time Applications.

[2]  Benoît G. Bardy,et al.  Action-perception patterns in virtual ball bouncing: Combating system latency and tracking functional validity , 2008, Journal of Neuroscience Methods.

[3]  Robert J. Teather,et al.  Effects of tracking technology, latency, and spatial jitter on object movement , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[4]  Chris Chafe,et al.  Effect of Time Delay on Ensemble Accuracy , 2004 .

[5]  Raymond H. Cuijpers,et al.  Joint Action: Neurocognitive Mechanisms Supporting Human Interaction , 2009, Top. Cogn. Sci..

[6]  Carlo Drioli,et al.  A statistical signature for automatic dialogue classification , 2008, 2008 19th International Conference on Pattern Recognition.

[7]  Ian D. Walker,et al.  A timing model for vision-based control of industrial robot manipulators , 2004, IEEE Transactions on Robotics.

[8]  Carlo Drioli,et al.  Time-varying delay measurement of video capture-to-display components with application to visual servoing , 2015, Signal Process. Image Commun..

[9]  Carlo Drioli,et al.  Networked Performances and Natural Interaction via LOLA: Low Latency High Quality A/V Streaming System , 2013, ECLAP.

[10]  G. Novembre,et al.  P 38. Motor simulation coordinates joint actions in real time: Music performance meets on-line double-pulse TMS , 2013, Clinical Neurophysiology.

[11]  Dimitri Konstantas,et al.  The Distributed Musical Rehearsal Environment , 1999, IEEE Multim..

[12]  P. Baranyi,et al.  Definition and synergies of cognitive infocommunications , 2012 .

[13]  Elaine Chew,et al.  Distributed musical performances: Architecture and stream management , 2008, TOMCCAP.

[14]  Carlo Drioli,et al.  Frequency map selection using a RBFN-based classifier in the MVDR beamformer for speaker localization in reverberant rooms , 2015, INTERSPEECH.

[15]  M. Tomasello,et al.  Understanding and sharing intentions: The origins of cultural cognition , 2005, Behavioral and Brain Sciences.

[16]  Carlo Drioli,et al.  Auditory dialog analysis and understanding by generative modelling of interactional dynamics , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[17]  Carlo Alberto Avizzano,et al.  Effect of delay on dynamic targets tracking performance and behavior in virtual environment , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[18]  Ravin Balakrishnan,et al.  Reaching for objects in VR displays: lag and frame rate , 1994, TCHI.