Automatic orchestration of video streams to enhance group communication

Unlike legacy video-conferencing, which connects two nodes each equipped with a camera, recent systems facilitating for video-mediated group communication deal simultaneously with a large number of video streams. This highlights the need for orchestration,, i.e. the intelligent selection of the most adequate camera views to be displayed on each screen. In this paper we present the initial results of a study that evaluates the effects of orchestration on communication within a specific context; that of two remote groups playing a collaborative board game. The results of the experiment indicate that automatic orchestration can provide improvements similar to the ones achieved when live video mixing is performed by human editors.

[1]  Manolis Falelakis,et al.  Improving video-mediated communication with orchestration , 2012, Comput. Hum. Behav..

[2]  Rafael Ballagas,et al.  Family communication: phone conversations with children , 2009, IDC.

[3]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[4]  Rene Kaiser,et al.  A Rule-Based Virtual Director Enhancing Group Communication , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[5]  K. Mani Chandy,et al.  10201 Executive Summary and Manifesto - Event Processing , 2010, Event Processing.

[6]  Rene Kaiser,et al.  Reasoning for video-mediated group communication , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[7]  Ehud Rivlin,et al.  Understanding Video Events: A Survey of Methods for Automatic Interpretation of Semantic Occurrences in Video , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  M. Pickering,et al.  Why is conversation so easy? , 2004, Trends in Cognitive Sciences.

[9]  John C. Tang,et al.  Social telepresence bakeoff: Skype group video calling, google+ hangouts, and microsoft avatar kinect , 2012, CSCW.

[10]  Petr Motlícek,et al.  Just-in-time multimodal association and fusion from home entertainment , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[11]  Pablo César,et al.  Video mediated social interaction between groups: System requirements and technology challenges , 2011, Telematics Informatics.