Exploration Mixed Reality Environment for Teleoperation Interface: An Option to Provide Effective Information

Mixed reality creates opportunities to enable manipulation of information obtained from a remote location within a virtual environment. A gaming environment, such as Second Life (SL), has similar characteristics with teleoperation interfaces and allows the users to immerse themselves and achieve the flow. This experiment was designed to explore a game environment which provides combined information by enhancing video views within a virtual world. We also explored whether our subjects utilised the information provided by the 3D model as well as the video views. From the experiment we found that all our subjects paid attention to 3D model and video views in all experiment tasks. The result also showed that in a condition where the information provided by 3D model was the same as the video views, all subjects who paid dominant attention to 3D model were able to complete the task. Data questionnaire showed that almost three-quarter of our subjects perceived that they need very short to moderate time to get familiar with the interface. In conclusion, augmented video views within gaming environment can be used to provide information and all subjects paid their attention to both sources of information, even though most of them paid attention predominately to video views.

[1]  Samir Otmane,et al.  A Distributed Software Architecture for Collaborative Teleoperation based on a VR Platform and Web Application Interoperability , 2009, ArXiv.

[2]  Paul Bourke,et al.  Evaluating Second Life as a tool for collaborative scientific visualisation , 2008 .

[3]  Alison Gazzard,et al.  Playing in a Virtual World: Exploration and Aspects of Play , 2007, 17th International Conference on Artificial Reality and Telexistence (ICAT 2007).

[4]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[5]  Ju-Jang Lee,et al.  Effectiveness of naked-eye vision feedback for training human teleoperators , 2004, 2004 5th Asian Control Conference (IEEE Cat. No.04EX904).

[6]  Michael Lewis,et al.  Usar: A Game Based Simulation for Teleoperation , 2003 .

[7]  Hideyuki Tamura,et al.  Mixed Reality: Future Dreams Seen at the Border between Real and Virtual Worlds , 2001, IEEE Computer Graphics and Applications.

[8]  David W. Hainsworth,et al.  Teleoperation User Interfaces for Mining Robotics , 2001, Auton. Robots.

[9]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[10]  Ken Taylor,et al.  Exploration of Second Life as a Virtual Game Environment for Teleoperation , 2010 .

[11]  Matt Adcock,et al.  The Development of a Telerobotic Rock Breaker , 2009, FSR.

[12]  Kalle Jegers,et al.  Pervasive game flow: understanding player enjoyment in pervasive gaming , 2007, CIE.

[13]  Yasushi Ikei,et al.  17th International Conference on Artificial Reality and Telexistence , 2007 .

[14]  Kevin Montgomery,et al.  Using Registration, Calibration, and Robotics to Build a More Accurate Virtual Reality Simulation for Astronaut Training and Telemedicine , 2003, WSCG.

[15]  Terrence Fong,et al.  A Personal User Interface for Collaborative Human-Robot Exploration , 2001 .

[16]  Qingping Lin,et al.  On Applying Virtual Reality to Underwater Robot Tele-Operation and Pilot Training , 2001, Int. J. Virtual Real..