Natural Virtual Reality User Interface to Define Assembly Sequences for Digital Human Models

Digital human models (DHMs) are virtual representations of human beings. They are used to conduct, among other things, ergonomic assessments in factory layout planning. DHM software tools are challenging in their use and thus require a high amount of training for engineers. In this paper, we present a virtual reality (VR) application that enables engineers to work with DHMs easily. Since VR systems with head-mounted displays (HMDs) are less expensive than CAVE systems, HMDs can be integrated more extensively into the product development process. Our application provides a reality-based interface and allows users to conduct an assembly task in VR and thus to manipulate the virtual scene with their real hands. These manipulations are used as input for the DHM to simulate, on that basis, human ergonomics. Therefore, we introduce a software and hardware architecture, the VATS (virtual action tracking system). This paper furthermore presents the results of a user study in which the VATS was compared to the existing WIMP (Windows, Icons, Menus and Pointer) interface. The results show that the VATS system enables users to conduct tasks in a significantly faster way.

[1]  Rainer Stark,et al.  Anforderungsanalyse einer Montagesimulationssoftware zwecks Aufwandsminimierung manueller Konfigurationsaufgaben , 2016, Useware.

[2]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[3]  Dima Damen,et al.  Cognitive Learning, Monitoring and Assistance of Industrial Workflows Using Egocentric Sensor Networks , 2015, PloS one.

[4]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[5]  Jochen Prümper.  Test It: ISONORM 9241/10 , 1999, HCI.

[6]  Frank Weichert,et al.  Analysis of the Accuracy and Robustness of the Leap Motion Controller , 2013, Sensors.

[7]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[9]  Dan Högberg,et al.  Creation of the IMMA manikin with consideration of anthropometric diversity , 2011 .

[10]  Jochen Prümper,et al.  Die Evaluation von Software auf Grundlage des Entwurfs zur internationalen Ergonomie-Norm ISO 9241 Teil 10 als Beitrag zur partizipativen Systemgestaltung - ein Fallbeispiel , 1993, Software-Ergonomie.

[11]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[12]  Rainer Stark,et al.  Visual Feedback for Grasping in Virtual Reality Environments for an Interface to Instruct Digital Human Models , 2017, AHFE.

[13]  Doug A. Bowman,et al.  Using Pinch Gloves(TM) for both Natural and Abstract Interaction Techniques in Virtual Environments , 2001 .

[14]  Dan Högberg,et al.  IMMA - Intelligently Moving Manikin - Project Status , 2010 .

[15]  Andries van Dam.  Beyond WIMP , 2000, IEEE Computer Graphics and Applications.