Assembly planning and evaluation in an augmented reality environment

Assembly planning is very critical in the product design process. Previously, computer-assisted assembly planning is mostly conducted in either an automated or interactive manner. Automated approaches can only be applied to products with simple component configurations, whereas extensive user input in the tedious form of answering questions is required for interactive approaches. Both kinds of approaches do not address issues related to human factors and ergonomics, which cannot be ignored in assembly planning especially in manual assembly. Using augmented reality technologies, an intuitive and efficient approach is proposed for manual assembly planning and evaluation by combining the potential strengths of the two kinds of approach. An AR-assisted assembly planning and evaluation system has been developed to implement the proposed methodology with the use of a 3D bare-hand interaction (3DBHI) tool. After loading all the parts of an assembly into the proposed system, assembly modelling is first completed through assembly geometrical constraint recognition and assembly location refinement with the use of the proposed 3DBHI tool. By analysing the disassembly process, precedence constraints are captured and used to search for feasible assembly sequences from all possible sequences, which are generated using an existing method. Finally, practical or good sequences are selected from the feasible sequences by exploiting an assembly index based on objective evaluation. A case study is conducted to demonstrate the application of the methodology and system.

[1]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[2]  Nong Ye,et al.  A comparative study of assembly planning in traditional and virtual environments , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[3]  Waldemar Karwowski.  The Strain Index , 2006 .

[4]  Randall H. Wilson.  Minimizing user queries in interactive assembly planning , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[5]  Pier Paolo Valentini,et al.  Interactive virtual assembling in augmented reality , 2009 .

[6]  Kevin W. Lyons,et al.  Virtual assembly using virtual reality techniques , 1997, Comput. Aided Des..

[7]  Leonard O'Sullivan,et al.  Effect on discomfort of frequency of wrist exertions combined with wrist articulations and forearm rotation , 2010 .

[8]  Yingxue Yao,et al.  Optimising assembly planning based on virtual reality and bionic algorithm , 2006, Int. J. Manuf. Technol. Manag..

[9]  Thomas L. DeFazio,et al.  An integrated computer aid for generating and evaluating assembly sequences for mechanical products , 1991, IEEE Trans. Robotics Autom..

[10]  Uma Jayaram,et al.  Industry case studies in the use of immersive virtual assembly , 2007, Virtual Reality.

[11]  D. Anton.  Occupational biomechanics , 1986 .

[12]  Arthur C. Sanderson,et al.  A correct and complete algorithm for the generation of mechanical assembly sequences , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[13]  Randall H. Wilson.  Minimizing user queries in interactive assembly planning , 1995, IEEE Trans. Robotics Autom..

[14]  Soh-Khim Ong,et al.  Integrated product design and assembly planning in an augmented reality environment , 2013 .

[15]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[16]  L. J. De Vin,et al.  Advanced machine service support using Internet-enabled three-dimensional-based virtual engineering , 2008 .

[17]  Timothy J. Gallwey,et al.  Effects of wrist posture, pace and exertion on discomfort , 2002 .

[18]  Sheik N. Imrhan,et al.  The effects of pinch width on pinch strengths of adult males using realistic pinch-handle coupling , 1995 .

[19]  Yong Wang,et al.  VADE: A Virtual Assembly Design Environment , 1999, IEEE Computer Graphics and Applications.

[20]  Tien-Chien Chang,et al.  3D MAPS: Three-dimensional mechanical assembly planning system , 1993 .

[21]  Thomas L. DeFazio,et al.  Simplified generation of all mechanical assembly sequences , 1987, IEEE Journal on Robotics and Automation.

[22]  Jan C. Aurich,et al.  Improvement of manufacturing processes with virtual reality-based CIP workshops , 2009 .

[23]  Randall H. Wilson,et al.  A survey of constraints in automated assembly planning , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[24]  Tiam-Hock Enga,et al.  Feature-based assembly modeling and sequence generation , 1999 .

[25]  Ji Zhang,et al.  RFID-assisted assembly guidance system in an augmented reality environment , 2011 .

[26]  Alfredo Liverani,et al.  A CAD-augmented Reality Integrated Environment for Assembly Sequence Check and Interactive Validation , 2004, Concurr. Eng. Res. Appl..

[27]  F Zorriassatine,et al.  A survey of virtual prototyping techniques for mechanical product development , 2003 .

[28]  Raymond Sung,et al.  Automatic Assembly Feature Recognition and Disassembly Sequence Generation , 2001, J. Comput. Inf. Sci. Eng..

[29]  Lawrence E. Whitman,et al.  Virtual reality: its usefulness for ergonomic analysis , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[30]  Dong Myung Lee,et al.  An approach to multi-criteria assembly sequence planning using genetic algorithms , 2009 .

[31]  F. Dweiri.  Fuzzy development of crisp activity relationship charts for facilities layout , 1999 .

[32]  Soh-Khim Ong,et al.  Augmented assembly technologies based on 3D bare-hand interaction , 2011 .

[33]  Andrew Y. C. Nee,et al.  Augmented reality for assembly guidance using a virtual interactive tool , 2008 .

[34]  Judy M. Vance,et al.  Virtual reality for assembly methods prototyping: a review , 2011, Virtual Reality.

[35]  Rajeev Sharma,et al.  Interactive evaluation of assembly sequences using augmented reality , 1999, IEEE Trans. Robotics Autom..

[36]  Andrew Y. C. Nee,et al.  Augmented reality applications in design and manufacturing , 2012 .

[37]  Z.-P. Yin,et al.  A virtual prototyping approach to generation and evaluation of mechanical assembly sequences , 2004 .

[38]  Mao-Jiun J. Wang,et al.  Motion generation and virtual simulation in a digital environment , 2012 .

[39]  Jack M. Walker,et al.  Handbook of manufacturing engineering , 1996 .

[40]  Yao Yingxue,et al.  Optimising assembly planning based on virtual reality and bionic algorithm , 2006 .

[41]  Willem F. Bronsvoort,et al.  Assembly features in modeling and planning , 2000 .

[42]  Ling Zhang,et al.  A collaborative approach to assembly sequence planning , 2005, Adv. Eng. Informatics.

[43]  Jakub Segen,et al.  Gesture VR: vision-based 3D hand interace for spatial interaction , 1998, MULTIMEDIA '98.

[44]  Arthur C. Sanderson,et al.  A correct and complete algorithm for the generation of mechanical assembly sequences , 1991, IEEE Trans. Robotics Autom..

[45]  Dianliang Wu,et al.  Tools and equipment modelling for interactive assembling operating in a virtual environment , 2011 .