Virtual reality for assembly methods prototyping: a review

Assembly planning and evaluation is an important component of the product design process in which details about how parts of a new product will be put together are formalized. A well designed assembly process should take into account various factors such as optimum assembly time and sequence, tooling and fixture requirements, ergonomics, operator safety, and accessibility, among others. Existing computer-based tools to support virtual assembly either concentrate solely on representation of the geometry of parts and fixtures and evaluation of clearances and tolerances or use simulated human mannequins to approximate human interaction in the assembly process. Virtual reality technology has the potential to support integration of natural human motions into the computer aided assembly planning environment (Ritchie et al. in Proc I MECH E Part B J Eng 213(5):461–474, 1999). This would allow evaluations of an assembler’s ability to manipulate and assemble parts and result in reduced time and cost for product design. This paper provides a review of the research in virtual assembly and categorizes the different approaches. Finally, critical requirements and directions for future research are presented.

[1]  Yang Luo,et al.  Realistic virtual hand modeling with applications for virtual grasping , 2004, VRCAI '04.

[2]  Steve Bryson.  Virtual reality in scientific visualization , 1993, Comput. Graph..

[3]  Jianrong Tan,et al.  Virtual assembly and tolerance analysis for collaborative design , 2005, Proceedings of the Ninth International Conference on Computer Supported Cooperative Work in Design, 2005..

[4]  Terrence Fernando,et al.  Direct 3D Manipulation Techniques for Interactive Constraint‐based Solid Modelling , 1993, Comput. Graph. Forum.

[5]  David Baraff,et al.  Curved surfaces and coherence for non-penetrating rigid body simulation , 1990, SIGGRAPH.

[6]  Judy M. Vance,et al.  Development of a Networked Haptic Environment in VR to Facilitate Collaborative Design Using Voxmap Pointshell (VPS) Software , 2004 .

[7]  Alejandro M. García-Alonso,et al.  Solving the collision detection problem , 1994, IEEE Computer Graphics and Applications.

[8]  D. Baraff.  Dynamic simulation of nonpenetrating rigid bodies , 1992 .

[9]  Brian Wyvill,et al.  Controlled Blending for Implicit Surfaces using a Graph , 1999 .

[10]  Jianrong Tan,et al.  Constrained behavior manipulation for interactive assembly in a virtual environment , 2007 .

[11]  Grigore C. Burdea,et al.  Haptics issues in virtual environments , 2000, Proceedings Computer Graphics International 2000.

[12]  Ronald Fedkiw,et al.  Nonconvex rigid bodies with stacking , 2003, ACM Trans. Graph..

[13]  Uma Jayaram,et al.  Design of a Haptic Device for Weight Sensation in Virtual Environments , 2002 .

[14]  Judy M. Vance,et al.  A DESKTOP NETWORKED HAPTIC VR INTERFACE FOR MECHANICAL ASSEMBLY , 2005 .

[15]  James K. Hahn,et al.  Realistic animation of rigid bodies , 1988, SIGGRAPH.

[16]  Christoph M. Hoffmann,et al.  A graph-constructive approach to solving systems of geometric constraints , 1997, TOGS.

[17]  J. C. Owen,et al.  Algebraic solution for geometry from dimensional constraints , 1991, SMA '91.

[18]  Holger Regenbrecht,et al.  Virtual reality aided assembly with directional vibro-tactile feedback , 2005, GRAPHITE '05.

[19]  Ying Zhang,et al.  The Use of Visual and Auditory Feedback for Assembly Task Performance in a Virtual Environment , 2005, IV.

[20]  Uma Jayaram,et al.  Introducing quantitative analysis methods into virtual environments for real-time and continuous ergonomic evaluations , 2006, Comput. Ind..

[21]  Uma Jayaram,et al.  Participatory ergonomics using VR integrated with analysis tools , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[22]  Judy M. Vance,et al.  Combining Geometric Constraints With Physics Modeling for Virtual Assembly Using SHARP , 2007 .

[23]  J. Edward Colgate,et al.  Design of a high performance haptic interface to virtual environments , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[24]  Terrence Fernando,et al.  A constraint manager to support virtual maintainability , 2003, Comput. Graph..

[25]  Judy M. Vance,et al.  Collision Detection and Part Interaction Modeling to Facilitate Immersive Virtual Assembly Methods , 2004, J. Comput. Inf. Sci. Eng..

[26]  Judy M. Vance,et al.  SHARP: A System for Haptic Assembly and Realistic Prototyping , 2006 .

[27]  Maxine D. Brown,et al.  The ImmersaDesk and Infinity Wall projection-based virtual reality displays , 1997, COMG.

[28]  Judy M. Vance,et al.  Using VPS (VoxMap Pointshell) as the Basis for Interaction in a Virtual Assembly Environment , 2003 .

[29]  F Zorriassatine,et al.  A survey of virtual prototyping techniques for mechanical product development , 2003 .

[30]  S. Jayaram,et al.  Functionality to Facilitate Assembly of Heavy Machines in a Virtual Environment , 2009 .

[31]  Brian Mirtich,et al.  V-Clip: fast and robust polyhedral collision detection , 1998, TOGS.

[32]  Bernhard Bettig,et al.  Port-Compatibility and Connectability Based Assembly Design , 2004, J. Comput. Inf. Sci. Eng..

[33]  Uma Jayaram,et al.  Embedding Haptics-Enabled Virtual Tools in CAD for Training Applications , 2006 .

[34]  Guozhong Dai,et al.  MIVAS: A Multi-Modal Immersive Virtual Assembly System , 2004 .

[35]  Andrew Witkin,et al.  Physically Based Modeling: Principles and Practice , 1997 .

[36]  Grigore C. Burdea,et al.  Invited review: the synergy between virtual reality and robotics , 1999, IEEE Trans. Robotics Autom..

[37]  Bernd Fröhlich,et al.  The Responsive Workbench [virtual work environment] , 1994, IEEE Computer Graphics and Applications.

[38]  Theodore Lim,et al.  Factors affecting user performance in haptic assembly , 2007, Virtual Reality.

[39]  B. Aldefeld.  Variation of geometrics based on a geometric-reasoning method , 1988 .

[40]  Terrence Fernando,et al.  Software architecture for a constraint-based virtual environment , 1999, VRST '99.

[41]  Kenny Erleben,et al.  Physics-based animation , 2005 .

[42]  T. Lim,et al.  Assessment of a Haptic Virtual Assembly System that uses Physics-based Interactions , 2007, 2007 IEEE International Symposium on Assembly and Manufacturing.

[43]  Blake Hannaford,et al.  Pen-based force display for precision manipulation in virtual environments , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[44]  Sai Cheong Fok,et al.  Integrated intelligent design and assembly planning: A survey , 1998 .

[45]  Grigore C. Burdea,et al.  The Rutgers Master II-new design force-feedback glove , 2002 .

[46]  Rakesh Gupta,et al.  Prototyping and design for assembly analysis using multimodal virtual environments , 1997, Comput. Aided Des..

[47]  Yong Wang,et al.  VADE: A Virtual Assembly Design Environment , 1999, IEEE Computer Graphics and Applications.

[48]  Satyandra K. Gupta,et al.  Towards the development of a virtual environment-based training system for mechanical assembly operations , 2007, Virtual Reality.

[49]  Fan Xiumin,et al.  Research on constraint-based virtual assembly technologies , 2007 .

[50]  Thomas L. DeFazio,et al.  Simplified generation of all mechanical assembly sequences , 1987, IEEE Journal on Robotics and Automation.

[51]  Thomas L. DeFazio,et al.  An integrated computer aid for generating and evaluating assembly sequences for mechanical products , 1991, IEEE Trans. Robotics Autom..

[52]  John Simmons,et al.  Assembly planning in a virtual environment , 1997, Innovation in Technology Management. The Key to Global Leadership. PICMET '97.

[53]  Kevin W. Lyons,et al.  Virtual assembly using virtual reality techniques , 1997, Comput. Aided Des..

[54]  Christoph M. Hoffmann,et al.  Constraint solving for computer-aided design , 1995 .

[55]  Michael Gleicher,et al.  Interactive dynamics , 1990, I3D '90.

[56]  Uma Jayaram,et al.  Industry case studies in the use of immersive virtual assembly , 2007, Virtual Reality.

[57]  David Baraff,et al.  Interactive simulation of solid rigid bodies , 1995, IEEE Computer Graphics and Applications.

[58]  Diego Borro,et al.  Collision problem: characteristics for a taxonomy , 2005, Ninth International Conference on Information Visualisation (IV'05).

[59]  H. J. Bullinger,et al.  Virtual assembly planning , 2000 .

[60]  Ming C. Lin,et al.  Collision Detection between Geometric Models: A Survey , 1998 .

[61]  Bert Bras,et al.  An Experiment on Weight Sensation in Real and Virtual Environments , 2004 .

[62]  Jonathan Corney,et al.  The Analysis of design and manufacturing tasks using haptic and immersive VR - Some case studies , 2008 .

[63]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[64]  Carme Torras,et al.  3D collision detection: a survey , 2001, Comput. Graph..

[65]  Gabriel Zachmann,et al.  Natural and Robust Interaction in Virtual Assembly Simulation , 2001 .

[66]  R. Light,et al.  Modification of geometric models through variational geometry , 1982 .

[67]  Dieter Roller,et al.  Rule-oriented method for parameterized computer-aided design , 1992, Comput. Aided Des..

[68]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[69]  Ming C. Lin,et al.  Accelerated proximity queries between convex polyhedra by multi-level Voronoi marching , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[70]  Christoph M. Hoffmann,et al.  Correctness proof of a geometric constraint solver , 1996, Int. J. Comput. Geom. Appl..

[71]  J. M. Ritchie,et al.  Immersive Virtual Reality In Cable and Pipe Routing: Design Metaphors and Cognitive Ergonomics , 2004, J. Comput. Inf. Sci. Eng..

[72]  Hiromasa Suzuki,et al.  Geometric constraints and reasoning for geometrical CAD systems , 1990, Comput. Graph..

[73]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[74]  Daniel Cohen-Or,et al.  Volume graphics , 1993, Computer.

[75]  Nong Ye,et al.  A comparative study of assembly planning in traditional and virtual environments , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[76]  Kemper Lewis,et al.  Visualization of multidimensional design and optimization data using cloud visualization , 2002, DAC 2002.

[77]  Christoph M. Hoffmann,et al.  Geometric constraint solver , 1995, Comput. Aided Des..

[78]  S. K. Gupta,et al.  Virtual Mentor: a step towards proactive user monitoring and assistance during virtual environment-based training , 2007 .

[79]  Xiaowu Chen,et al.  A virtual environment for collaborative assembly , 2005, Second International Conference on Embedded Software and Systems (ICESS'05).

[80]  Arthur C. Sanderson,et al.  A correct and complete algorithm for the generation of mechanical assembly sequences , 1991, IEEE Trans. Robotics Autom..

[81]  Bert Bras,et al.  A Haptic Assembly and Disassembly Simulation Environment and Associated Computational Load Optimization Techniques , 2001, J. Comput. Inf. Sci. Eng..

[82]  Dinesh Manocha,et al.  CULLIDE: interactive collision detection between complex models in large environments using graphics hardware , 2003, HWWS '03.

[83]  Judy M. Vance,et al.  Effectiveness of Haptic Sensation for the Evaluation of Virtual Prototypes , 2001, J. Comput. Inf. Sci. Eng..

[84]  Raymond Sung,et al.  Automatic Assembly Feature Recognition and Disassembly Sequence Generation , 2001, J. Comput. Inf. Sci. Eng..

[85]  Wang Fei,et al.  Solving sequential decision-making problems under virtual reality simulation system , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[86]  Gabriel Zachmann,et al.  Virtual reality as a tool for verification of assembly and maintenance processes , 1999, Comput. Graph..

[87]  Yong Wang,et al.  PHYSICALLY BASED MODELING IN VIRTUAL ASSEMBLY , 2001 .

[88]  George Chryssolouris,et al.  A virtual reality-based experimentation environment for the verification of human-related factors in assembly processes , 2000 .

[89]  Samir Garbaya,et al.  The affect of contact force sensations on user performance in virtual assembly tasks , 2007, Virtual Reality.

[90]  John F. Canny,et al.  Impulse-based simulation of rigid bodies , 1995, I3D '95.

[91]  Brian Mirtich,et al.  Impulse-based dynamic simulation of rigid body systems , 1996 .

[92]  Ernie Appleton,et al.  Product Design for Manufacture and Assembly , 2008 .

[93]  John Simmons,et al.  The generation and practical use of plans for manual assembly using immersive virtual reality , 1999 .

[94]  Marc Erich Latoschik,et al.  Knowledge-based assembly simulation for virtual prototype modeling , 1998, IECON '98. Proceedings of the 24th Annual Conference of the IEEE Industrial Electronics Society (Cat. No.98CH36200).

[95]  Bert Bras,et al.  Collision Detection for Virtual Objects in a Haptic Assembly and Disassembly Simulation Environment , 2002 .

[96]  Grigore C. Burdea,et al.  The Rutgers Master II-ND force feedback glove , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[97]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[98]  Uma Jayaram,et al.  CORBA-Based Collaboration in a Virtual Assembly Design Environment , 2009 .

[99]  Ming C. Lin,et al.  Accurate and Fast Proximity Queries Between Polyhedra Using Convex Surface Decomposition , 2001, Comput. Graph. Forum.

[100]  Shana Smith,et al.  Automatic stable assembly sequence generation and evaluation , 2001 .

[101]  Xiaogang Jin,et al.  General constrained deformations based on generalized metaballs , 1998, Proceedings Pacific Graphics '98. Sixth Pacific Conference on Computer Graphics and Applications (Cat. No.98EX208).

[102]  M. Levas.  OBBTree : A Hierarchical Structure for Rapid Interference Detection , .

[103]  Jing-Rong Li,et al.  A CAD-linked virtual assembly environment , 2006 .

[104]  Henrik Tramberend,et al.  Physically-based manipulation on the Responsive Workbench , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[105]  Dinesh Manocha,et al.  V-COLLIDE: accelerated collision detection for VRML , 1997, VRML '97.

[106]  Yang Luo,et al.  Grasp Identification and Multi-Finger Haptic Feedback for Virtual Assembly , 2004 .

[107]  Yong Wang,et al.  Methods and Algorithms for Constraint-based Virtual Assembly , 2003, Virtual Reality.

[108]  Dinesh Manocha,et al.  I-COLLIDE: an interactive and exact collision detection system for large-scale environments , 1995, I3D '95.