OptoBridge: assisting skill acquisition in the remote experimental collaboration

In this paper an experimental teaching platform named OptoBridge is presented which supports the sharing of the collaborative space for spatially distributed users to assist skill acquisition. The development of OptoBridge is based on augmented reality (AR) and integrates free-hand gesture interactions with the video mediated communication. The prototype is preliminarily applied in the optics field to promote skill execution in the case of the Michelson interferometer. OptoBridge enables the remote teacher to monitor the experimental scenario as well as the detailed optical phenomena through the transmitted video captured on the local side. Meanwhile the local learner equipped with the optical see-through head-mounted display (OSTHMD) can be indicated by virtual hands and augmented annotations controlled by the teacher's gestures and follow the guidance to get their skills practiced. The implementation of OptoBridge is also presented, aimed at providing a more engaging and efficient approach for remote skill teaching.

[1]  Holger Regenbrecht,et al.  A leap-supported, hybrid AR interface approach , 2013, OZCHI.

[2]  Xiangyu Wang,et al.  Here and there: Experiencing co-presence through mixed reality-mediated collaborative design system , 2008, 2008 8th IEEE International Conference on Computer and Information Technology.

[3]  Anthony Tang,et al.  OneSpace: shared visual scenes for active freeplay , 2014, CHI.

[4]  Christian Gütl,et al.  Virtual laboratories for education in science, technology, and engineering: A review , 2016, Comput. Educ..

[5]  Judith Amores,et al.  ShowMe: A Remote Collaboration System that Supports Immersive Gestural Communication , 2015, CHI Extended Abstracts.

[6]  André Hinkenjann,et al.  Augmenting magnetic field lines for school experiments , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[7]  Craig Chapman,et al.  Augmented reality environment for engineering distance leaners to acquire practical skills , 2016, 2016 13th International Conference on Remote Engineering and Virtual Instrumentation (REV).

[8]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.

[9]  Michael Kozhevnikov,et al.  Virtual-reality-based educational laboratories in fiber optic engineering , 2014 .

[10]  Ehud Sharlin,et al.  Haptics in remote collaborative exercise systems for seniors , 2014, CHI Extended Abstracts.

[11]  F. P. Maciel Barbosa,et al.  Distance education using a desktop virtual reality (VR) system , 2013, 2013 24th EAEEIE Annual Conference (EAEEIE 2013).

[12]  Kazuaki Tanaka,et al.  Remote handshaking: touch enhances video-mediated social telepresence , 2014, CHI.

[13]  Hannes Kaufmann,et al.  Simulating educational physical experiments in augmented reality , 2008, SIGGRAPH Asia '08.

[14]  Z. Zacharia,et al.  Physical and Virtual Laboratories in Science and Engineering Education , 2013, Science.

[15]  Sangtae Ha,et al.  Automatically Freezing Live Video for Annotation during Remote Collaboration , 2015, CHI Extended Abstracts.

[16]  R. Meier,et al.  Control of a remote laboratory by augmented reality , 2012, Proceedings of IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE) 2012.

[17]  Steven K. Feiner,et al.  Virtual Replicas for Remote Assistance in Virtual and Augmented Reality , 2015, UIST.

[18]  J. M. Andújar Márquez,et al.  A Pilot Study of the Effectiveness of Augmented Reality to Enhance the Use of Remote Labs in Electrical Engineering Education , 2012 .

[19]  Kazuaki Tanaka,et al.  Robot conferencing: physically embodied motions enhance social telepresence , 2014, CHI Extended Abstracts.

[20]  Daniel G. Aliaga,et al.  Mixed Reality Tabletop (MRT): A Low-Cost Teleconferencing Framework for Mixed-Reality Applications , 2006, IEEE Virtual Reality Conference (VR 2006).

[21]  Bilge Mutlu,et al.  Bodies in motion: mobility, presence, and task awareness in telepresence , 2014, CHI.

[22]  Mark Billinghurst,et al.  Free-hand Gesture Interfaces for an Augmented Exhibition Podium , 2015, OZCHI.