Comparing Visual Assembly Aids for Augmented Reality Work Instructions

Increased product complexity and the focus on zero defects, especially when manufacturing complex engineered products, means new tools are required for helping workers conduct challenging assembly tasks. Augmented reality (AR) has shown considerable promise in delivering work instructions over traditional methods. Many proof-of-concept systems have demonstrated the feasibility of AR but little work has been devoted to understanding how users perceive different AR work instruction interface elements. This paper presents a between-subjects study looking at how interface elements for object depth placement in a scene impact a user’s ability to quickly and accurately assemble a mock aircraft wing in a standard work cell. For object depth placement, modes with varying degrees of 3D modeled occlusion were tested, including a control group with no occlusion, virtual occlusion, and occlusion by contours. Results for total assembly time and total errors indicated no statistically significant difference between interfaces, leading the authors to conclude a floor has been reached for optimizing the current assembly when using AR for work instruction delivery. However, looking at a handful of highly error prone steps showed the impact different types of occlusion have on helping users correctly complete an assembly task. The results of the study provide insight into how to construct an interface for delivering AR work instructions using occlusion. Based on these results, the authors recommend customizing the occlusion method based on the features of the required assembly task. The authors also identified a floor effect for the steps of the assembly process, which involved picking the necessary parts from tables and bins. The authors recommend using vibrant outlines and large textual cues (e.g., numbers on parts bins) as interface elements to guide users during these types of “picking” steps. Disciplines Electrical and Computer Engineering | Ergonomics | Mechanical Engineering | Operations Research, Systems Engineering and Industrial Engineering Comments This proceeding was published as MacAllister, Anastacia, Melynda Hoover, Stephen Gilbert, James Oliver, Rafael Radkowski, Timothy Garrett, Joseph Holub, Eliot Winer, Scott Terry, and Paul Davies. (2017). "Comparing Visual Assembly Aids for Augmented Reality Work Instructions." In Volume 2017, Proceedings of the 2017 Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC). Paper no. 17208. Arlington, VA: National Training and Simulation Association. Posted with permission. Authors Anastacia MacAllister, Melynda Hoover, Stephen Gilbert, James Oliver, Rafael Radkowski, Timothy Garrett, Joseph Holub, Eliot Winer, Scott Terry, and Paul Davies This presentation is available at Iowa State University Digital Repository: https://lib.dr.iastate.edu/me_conf/197 Interservice/Industry Training, Simulation, and Education Conference (I/ITSEC) 2017 2017 Paper No. 17208 Page 1 of 14 Comparing Visual Assembly Aids for Augmented Reality Work Instructions Anastacia MacAllister, Melynda Hoover, Stephen Gibert, James Oliver, Rafael Radkowski, Timothy Garrett, Joseph Holub, Eliot Winer Scott Terry, Paul Davies Iowa State University The Boeing Company Ames, Iowa St. Louis, Missouri anastac@iastate.edu, mthoover@iastate.edu, gilbert@iastate.edu, oliver@iastate.edu, rafael@iastate.edu, garrettt@iastate.edu, jholub@iastate.edu, ewiner@iastate.edu scott.a.terry@boeing.com paul.r.davies@boeing.com

[1]  Andrew Y. C. Nee,et al.  A comprehensive survey of augmented reality assembly research , 2016, Advances in Manufacturing.

[2]  Rajeev Sharma,et al.  Interactive evaluation of assembly sequences using augmented reality , 1999, IEEE Trans. Robotics Autom..

[3]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[4]  Siam Charoenseang,et al.  Augmented reality for skill transfer in assembly task , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[5]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[6]  Lida Xu,et al.  AutoAssem: An Automated Assembly Planning System for Complex Products , 2012, IEEE Transactions on Industrial Informatics.

[7]  Wolfgang Friedrich,et al.  ARVIKA-augmented reality for development, production and service , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[8]  Paul Davies,et al.  Fusing Self-Reported and Sensor Data from Mixed-Reality Training , 2014 .

[9]  Woodrow Barfield,et al.  Evaluating the effectiveness of augmented reality displays for a manual assembly task , 1999, Virtual Reality.

[10]  James H. Oliver,et al.  Augmented Reality-Based Manual Assembly Support With Visual Features for Different Degrees of Difficulty , 2015, Int. J. Hum. Comput. Interact..

[11]  Ruth B. Ekstrom,et al.  Manual for kit of factor-referenced cognitive tests , 1976 .

[12]  Holger Regenbrecht,et al.  Developing and Applying AR Technology in Design, Production, Service and Training , 2004 .

[13]  Olaf Oehme,et al.  Augmented Reality (AR) for Assembly Processes Design and Experimental Evaluation , 2003, Int. J. Hum. Comput. Interact..

[14]  F. Reichheld The one number you need to grow. , 2003, Harvard business review.

[15]  László Monostori,et al.  Complexity in engineering design and manufacturing , 2012 .

[16]  Kwang-Ho Seok,et al.  A Study on Providing Prompt Assembly Information Using AR Manual , 2008, 2008 Third International Conference on Convergence and Hybrid Information Technology.

[17]  Panagiotis D. Ritsos,et al.  Standards for Augmented Reality: a User Experience perspective , 2011 .

[18]  Polona Vilar,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction (5th edition) , 2010, J. Assoc. Inf. Sci. Technol..

[19]  Jill Gerhardt‐Powals,et al.  Cognitive engineering principles for enhancing human-computer performance , 1996, Int. J. Hum. Comput. Interact..

[20]  Anna Wong,et al.  Should hand actions be observed when learning hand motor skills from instructional animations? , 2013, Comput. Hum. Behav..

[21]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[22]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .