Gain A New Perspective: Towards Exploring Multi-View Alignment in Mixed Reality

Manufacturing, maintenance, assembly, and training tasks represent some of the human activities that have captured special interest for Mixed Reality (MR) applications. For most of these scenarios, accurate object alignment constitutes a requirement to ensure the desired outcome. This task has proved to be especially challenging in egocentric approaches, frequently leading to estimation errors in depth. While traditional MR methods provide virtual guides such as text, arrows, or animations to assist users during alignment, this work explores the feasibility of using additional views generated by virtual cameras and mirrors. Presenting additional views from different perspectives can help to mitigate the estimation errors and show information that is not directly visible to users.To explore the benefits of using additional views for alignment tasks, and to collect reliable data and diminish external factors, we conducted a user study in a controlled virtual environment where participants aligned objects supported by additional views from a top-down camera and virtual mirrors. Data regarding alignment error, time to completion, user’s interaction and attention, distance traveled, average head velocity, usability, and mental effort were collected. Our results show that using additional views reduces the mental effort and distance traveled by users and increases acceptance without negatively affecting the alignment accuracy. Therefore, we believe that users will also benefit from integrating these techniques during alignment tasks in MR environments.

[1]  Blair MacIntyre,et al.  An evaluation of graphical context when the graphics are outside of the task area , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[2]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[3]  F. Paas Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. , 1992 .

[4]  Eric Kolstad,et al.  The Effects of Virtual Reality, Augmented Reality, and Motion Parallax on Egocentric Depth Perception , 2008, 2008 IEEE Virtual Reality Conference.

[5]  Peter Willemsen,et al.  The Influence of Restricted Viewing Conditions on Egocentric Distance Perception: Implications for Real and Virtual Indoor Environments , 2005, Perception.

[6]  Eric Kolstad,et al.  Egocentric depth judgments in optical, see-through augmented reality , 2007, IEEE Transactions on Visualization and Computer Graphics.

[7]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[8]  Steven K. Feiner,et al.  Augmented reality in the psychomotor phase of a procedural task , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[9]  Steven K. Feiner,et al.  Quick viewpoint switching for manipulating virtual objects in hand-held augmented reality using stored snapshots , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[10]  Peter Kazanzides,et al.  ARAMIS: Augmented Reality Assistance for Minimally Invasive Surgery Using a Head-Mounted Display , 2019, MICCAI.

[11]  Bruce H. Thomas,et al.  Augmented Viewport: An action at a distance technique for outdoor AR using distant and zoom lens cameras , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[12]  Didier Stricker,et al.  Augmented reality for construction tasks: doorlock assembly , 1999 .

[13]  Kiyoshi Kiyokawa,et al.  A Tunnel Window and Its Variations : Seamless Teleportation Techniques in a Virtual Environment , 2005 .

[14]  Peter Willemsen,et al.  The effects of head-mounted display mechanics on distance judgments in virtual environments , 2004, APGV '04.

[15]  Nassir Navab,et al.  The Virtual Mirror: A New Interaction Paradigm for Augmented Reality Environments , 2009, IEEE Transactions on Medical Imaging.

[16]  Kiyoshi Kiyokawa,et al.  Interactive Reconfiguration Techniques of Reference Frame Hierarchy in the Multi-viewport Interface , 2006, 3D User Interfaces (3DUI'06).

[17]  Romero Tori,et al.  3PI experiment: immersion in third-person view , 2010, Sandbox '10.

[18]  Jack M. Loomis,et al.  Visual perception of egocentric distance in real and virtual environments. , 2003 .

[19]  Mitsunori Tada,et al.  Dollhouse VR: a multi-view, multi-user collaborative design workspace with VR technology , 2015, SIGGRAPH Asia Posters.

[20]  Nassir Navab,et al.  Augmented reality-based feedback for technician-in-the-loop C-arm repositioning , 2018, Healthcare technology letters.

[21]  Christian Geiger,et al.  Mobile augmented reality illustrations that entertain and inform: design and implementation issues with the hololens , 2017, SIGGRAPH ASIA Mobile Graphics and Interactive Applications.

[22]  Mark T. Keane,et al.  Using an Industry-ready AR HMD on a Real Maintenance Task: AR Benefits Performance on Certain Task Steps More Than Others , 2018 .

[23]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[24]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[25]  J. Hintze,et al.  Violin plots : A box plot-density trace synergism , 1998 .

[26]  Alexander Kulik,et al.  Multi-Window 3D Interaction for Collaborative Virtual Reality , 2020, IEEE Transactions on Visualization and Computer Graphics.

[27]  Kiyoshi Kiyokawa,et al.  The effectiveness of an AR-based context-aware assembly support system in object assembly , 2014, 2014 IEEE Virtual Reality (VR).

[28]  Tobias Höllerer,et al.  A replication study testing the validity of AR simulation in VR for controlled experiments , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[29]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[30]  Xabier E. Barandiaran,et al.  A Dynamical Systems Account of Sensorimotor Contingencies , 2013, Front. Psychol..

[31]  Brian A. Hargreaves,et al.  Mixed-Reality Guidance for Brain Stimulation Treatment of Depression , 2018, 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct).

[32]  Tyrone L. Vincent,et al.  Analysis of Head Pose Accuracy in Augmented Reality , 2000, IEEE Trans. Vis. Comput. Graph..

[33]  Mathias Unberath,et al.  Reflective-AR Display: An Interaction Methodology for Virtual-Real Alignment in Medical Robotics , 2019, ArXiv.

[34]  Ulrich Eck,et al.  Visualization Techniques for Precise Alignment in VR: A Comparative Study , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[35]  Anderson Maciel,et al.  Design and Assessment of a Collaborative 3D Interaction Technique for Handheld Augmented Reality , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[36]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[37]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.