Comparative evaluation of WIMP and immersive natural finger interaction: a user study on CAD assembly modeling

Virtual and augmented reality allows the utilization of natural user interfaces, such as realistic finger interaction, even for purposes that were previously dominated by the WIMP paradigm. This new form of interaction is particularly suitable for applications involving manipulation tasks in 3D space, such as CAD assembly modeling. The objective of this paper is to evaluate the suitability of natural interaction for CAD assembly modeling in virtual reality. An advantage of the natural interaction compared to the conventional operation by computer mouse would indicate development potential for user interfaces of current CAD applications. Our approach bases on two main elements. Firstly, a novel natural user interface for realistic finger interaction enables the user to interact with virtual objects similar to physical ones. Secondly, an algorithm automatically detects constraints between CAD components based solely on their geometry and spatial location. In order to prove the usability of the natural CAD assembly modeling approach in comparison with the assembly procedure in current WIMP operated CAD software, we present a comparative user study. Results show that the VR method including natural finger interaction significantly outperforms the desktop-based CAD application in terms of efficiency and ease of use.

[1]  Csaba Antonya,et al.  A comparative evaluation of human interaction for design and assembly of 3D CAD models in desktop and immersive environments , 2012 .

[2]  Stephan Lukosch,et al.  On the Efficiency of a VR Hand Gesture-Based Interface for 3D Object Manipulations in Conceptual Design , 2017, Int. J. Hum. Comput. Interact..

[3]  Arun Yoganandan,et al.  Comparison of a two-handed interface to a wand interface and a mouse interface for fundamental 3D tasks , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[4]  Maud Marchal,et al.  The god-finger method for improving 3D interaction with virtual objects through simulation of contact area , 2013, 2013 IEEE Symposium on 3D User Interfaces (3DUI).

[5]  Terrence Fernando,et al.  A constraint manager to support virtual maintainability , 2003, Comput. Graph..

[6]  Terrence Fernando,et al.  Direct 3D Manipulation Techniques for Interactive Constraint‐based Solid Modelling , 1993, Comput. Graph. Forum.

[7]  A. Joshi,et al.  Likert Scale: Explored and Explained , 2015 .

[8]  A. Elhan,et al.  Investigation of Four Different Normality Tests in Terms of Type 1 Error Rate and Power under Different Distributions , 2006 .

[9]  Pier Paolo Valentini,et al.  Interactive virtual assembling in augmented reality , 2009 .

[10]  Andrea Giachetti,et al.  A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments , 2018, Comput. Graph. Forum.

[11]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[12]  Jeff Sauro,et al.  Quantifying the User Experience: Practical Statistics for User Research , 2012 .

[13]  Jeremy R. Cooperstock,et al.  Did "Minority Report" Get It Wrong? Superiority of the Mouse over 3D Input Devices in a 3D Placement Task , 2009, INTERACT.

[14]  Andries van Dam,et al.  Post-WIMP user interfaces , 1997, CACM.

[15]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[16]  Abhishek Seth,et al.  Combining physical constraints with geometric constraint-based modeling for virtual assembly , 2007 .

[17]  Frol Periverzov,et al.  IDS: The intent driven selection method for natural user interfaces , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[18]  Judy M. Vance,et al.  Combining Geometric Constraints With Physics Modeling for Virtual Assembly Using SHARP , 2007 .

[19]  Bernd Fröhlich,et al.  A generalized God-object method for plausible finger-based interactions in virtual environments , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[20]  Judy M. Vance,et al.  Virtual reality for assembly methods prototyping: a review , 2011, Virtual Reality.

[21]  Mariangela Lazoi,et al.  CAD-VR Integration as a Tool for Industrial Assembly Processes Validation: A Practical Application , 2018, AVR.

[22]  Soh-Khim Ong,et al.  Augmented reality aided interactive manual assembly design , 2013, The International Journal of Advanced Manufacturing Technology.

[23]  Yong Wang,et al.  VADE: A Virtual Assembly Design Environment , 1999, IEEE Computer Graphics and Applications.

[24]  Bernd Fröhlich,et al.  A soft hand model for physically-based manipulation of virtual objects , 2011, 2011 IEEE Virtual Reality Conference.

[25]  Bernd Fröhlich,et al.  Pseudo-physical interaction with a virtual car interior in immersive environments , 2005, EGVE'05.

[26]  Pier Paolo Valentini,et al.  Natural interface for interactive virtual assembly in augmented reality using Leap Motion Controller , 2018 .

[27]  Sandro Wartzack,et al.  Natural Finger Interaction for CAD Assembly Modeling , 2017 .

[28]  Michael Ortega-Binderberger,et al.  A Six Degree-of-Freedom God-Object Method for Haptic Display of Rigid Bodies with Surface Properties , 2007, IEEE Transactions on Visualization and Computer Graphics.

[29]  Stephanie Houde,et al.  Iterative design of an interface for easy 3-D direct manipulation , 1992, CHI.

[30]  Junyan Liu,et al.  A pragmatic system to support interactive assembly planning and training in an immersive virtual environment (I-VAPTS) , 2006 .

[31]  Andrew Y. C. Nee,et al.  A comprehensive survey of augmented reality assembly research , 2016, Advances in Manufacturing.

[32]  Christoph W. Borst,et al.  A Spring Model for Whole-Hand Virtual Grasping , 2006, Presence: Teleoperators & Virtual Environments.

[33]  H. Rex Hartson,et al.  Developing user interfaces: ensuring usability through product & process , 1993 .

[34]  T. Ullmann,et al.  Intuitive virtual grasping for non haptic environments , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[35]  Sungmin Cho,et al.  GaFinC: Gaze and Finger Control interface for 3D model manipulation in CAD application , 2014, Comput. Aided Des..

[36]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[37]  Mark Weiser.  The computer for the 21st century , 1991 .

[38]  Bilge Mutlu,et al.  Understanding human-robot interaction in virtual reality , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).