Mixed reality collaboration through sharing a live panorama

One of the popular features on modern social networking platforms is sharing live 360 panorama video. This research investigates on how to further improve shared live panorama based collaborative experiences by applying Mixed Reality (MR) technology. Shared-Sphere is a wearable MR remote collaboration system. In addition to sharing a live captured immersive panorama, SharedSphere enriches the collaboration through overlaying MR visualisation of non-verbal communication cues (e.g., view awareness and gestures cues). User feedback collected through a preliminary user study indicated that sharing of live 360 panorama video was beneficial by providing a more immersive experience and supporting view independence. Users also felt that the view awareness cues were helpful for understanding the remote collaborator's focus.

[1]  Mark Billinghurst,et al.  Do You See What I See? The Effect of Gaze Tracking on Task Space Remote Collaboration , 2016, IEEE Transactions on Visualization and Computer Graphics.

[2]  Mark Billinghurst,et al.  Social panoramas: using wearable computers to share experiences , 2014, SIGGRAPH ASIA Mobile Graphics and Interactive Applications.

[3]  Mark Billinghurst,et al.  Improving co-presence with augmented visual communication cues for sharing experience through video conference , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[4]  Carman Neustaedter,et al.  Collaboration with 360° Videochat: Challenges and Opportunities , 2017, Conference on Designing Interactive Systems.

[5]  Tobias Höllerer,et al.  In touch with the remote world: remote collaboration with augmented reality drawings and virtual navigation , 2014, VRST '14.

[6]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[7]  Lei Gao,et al.  An oriented point-cloud view for MR remote collaboration , 2016, SIGGRAPH ASIA Mobile Graphics and Interactive Applications.

[8]  Jun Rekimoto,et al.  JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera , 2017, IEEE Trans. Vis. Comput. Graph..

[9]  Weidong Huang,et al.  3D helping hands: a gesture based MR system for remote collaboration , 2012, VRCAI '12.

[10]  Keita Higuchi,et al.  Can Eye Help You?: Effects of Visualizing Eye Fixations on Remote Collaboration Scenarios for Physical Tasks , 2016, CHI.