Combining physical constraints with geometric constraint-based modeling for virtual assembly

Virtual reality (VR) technology holds promise as a virtual prototyping (VP) tool for mechanical assembly; however, several developmental challenges still need to be addressed before virtual prototyping applications can successfully be integrated into the product realization process. This paper categorizes and elaborates these challenges and then describes how SHARP (System for Haptic Assembly & Realistic Prototyping), addresses them for virtual assembly. SHARP uses physics-based modeling for simulating realistic part-to-part and hand-to-part interactions in virtual environments. A dual handed haptic interface is presented for realistic hand-part interaction. Additional modules are added to utilize the system to provide answers for maintenance issues, virtual training

[1]  Uma Jayaram,et al.  Design of a Haptic Device for Weight Sensation in Virtual Environments , 2002 .

[2]  J. Edward Colgate,et al.  Design of a high performance haptic interface to virtual environments , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[3]  Rakesh Gupta,et al.  Prototyping and design for assembly analysis using multimodal virtual environments , 1997, Comput. Aided Des..

[4]  John Simmons,et al.  Assembly planning in a virtual environment , 1997, Innovation in Technology Management. The Key to Global Leadership. PICMET '97.

[5]  Kevin W. Lyons,et al.  Virtual assembly using virtual reality techniques , 1997, Comput. Aided Des..

[6]  Judy M. Vance,et al.  A DESKTOP NETWORKED HAPTIC VR INTERFACE FOR MECHANICAL ASSEMBLY , 2005 .

[7]  James K. Hahn,et al.  Realistic animation of rigid bodies , 1988, SIGGRAPH.

[8]  F Zorriassatine,et al.  A survey of virtual prototyping techniques for mechanical product development , 2003 .

[9]  Holger Regenbrecht,et al.  Virtual reality aided assembly with directional vibro-tactile feedback , 2005, GRAPHITE '05.

[10]  John F. Canny,et al.  Impulse-based simulation of rigid bodies , 1995, I3D '95.

[11]  B. Aldefeld.  Variation of geometrics based on a geometric-reasoning method , 1988 .

[12]  Judy M. Vance,et al.  Collision Detection and Part Interaction Modeling to Facilitate Immersive Virtual Assembly Methods , 2004, J. Comput. Inf. Sci. Eng..

[13]  Brian Mirtich,et al.  Impulse-based dynamic simulation of rigid body systems , 1996 .

[14]  Christoph M. Hoffmann,et al.  Constraint solving for computer-aided design , 1995 .

[15]  Kenny Erleben,et al.  Physics-based animation , 2005 .

[16]  Michael Gleicher,et al.  Interactive dynamics , 1990, I3D '90.

[17]  Jianrong Tan,et al.  Virtual assembly and tolerance analysis for collaborative design , 2005, Proceedings of the Ninth International Conference on Computer Supported Cooperative Work in Design, 2005..

[18]  Uma Jayaram,et al.  Introducing quantitative analysis methods into virtual environments for real-time and continuous ergonomic evaluations , 2006, Comput. Ind..

[19]  Uma Jayaram,et al.  Participatory ergonomics using VR integrated with analysis tools , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[20]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[21]  Gabriel Zachmann,et al.  Virtual reality as a tool for verification of assembly and maintenance processes , 1999, Comput. Graph..

[22]  Yong Wang,et al.  PHYSICALLY BASED MODELING IN VIRTUAL ASSEMBLY , 2001 .

[23]  Terrence Fernando,et al.  Software architecture for a constraint-based virtual environment , 1999, VRST '99.

[24]  Terrence Fernando,et al.  Interactive Assembly Modelling within a CAVE Environment , 2000 .

[25]  David Baraff,et al.  Interactive simulation of solid rigid bodies , 1995, IEEE Computer Graphics and Applications.

[26]  S. Jayaram,et al.  Functionality to Facilitate Assembly of Heavy Machines in a Virtual Environment , 2009 .

[27]  Brian Mirtich,et al.  V-Clip: fast and robust polyhedral collision detection , 1998, TOGS.

[28]  Yong Wang,et al.  VADE: A Virtual Assembly Design Environment , 1999, IEEE Computer Graphics and Applications.

[29]  Henrik Tramberend,et al.  Physically-based manipulation on the Responsive Workbench , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[30]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[31]  Daniel Cohen-Or,et al.  Volume graphics , 1993, Computer.

[32]  Fan Xiumin,et al.  Research on constraint-based virtual assembly technologies , 2007 .

[33]  Nong Ye,et al.  A comparative study of assembly planning in traditional and virtual environments , 1999, IEEE Trans. Syst. Man Cybern. Part C.

[34]  Judy M. Vance,et al.  Combining Geometric Constraints With Physics Modeling for Virtual Assembly Using SHARP , 2007 .

[35]  Terrence Fernando,et al.  A constraint manager to support virtual maintainability , 2003, Comput. Graph..

[36]  Kemper Lewis,et al.  Visualization of multidimensional design and optimization data using cloud visualization , 2002, DAC 2002.

[37]  Dinesh Manocha,et al.  V-COLLIDE: accelerated collision detection for VRML , 1997, VRML '97.

[38]  Yang Luo,et al.  Grasp Identification and Multi-Finger Haptic Feedback for Virtual Assembly , 2004 .

[39]  Yong Wang,et al.  Methods and Algorithms for Constraint-based Virtual Assembly , 2003, Virtual Reality.

[40]  Blake Hannaford,et al.  Pen-based force display for precision manipulation in virtual environments , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[41]  G. Gary Wang,et al.  Definition and Review of Virtual Prototyping , 2002, J. Comput. Inf. Sci. Eng..

[42]  Dinesh Manocha,et al.  I-COLLIDE: an interactive and exact collision detection system for large-scale environments , 1995, I3D '95.

[43]  Dieter Roller,et al.  Rule-oriented method for parameterized computer-aided design , 1992, Comput. Aided Des..

[44]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[45]  Ming C. Lin,et al.  Accelerated proximity queries between convex polyhedra by multi-level Voronoi marching , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[46]  Diego Borro,et al.  Description of a haptic system for virtual maintainability in aeronautics , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[47]  Carme Torras,et al.  3D collision detection: a survey , 2001, Comput. Graph..

[48]  Bert Bras,et al.  A Comparison of Two Collision Detection Libraries in a Haptic Simulation Environment , 2004 .

[49]  Gabriel Zachmann,et al.  Natural and Robust Interaction in Virtual Assembly Simulation , 2001 .

[50]  Hanqiu Sun,et al.  Mechanical assembly with data glove devices , 1997, CCECE '97. Canadian Conference on Electrical and Computer Engineering. Engineering Innovation: Voyage of Discovery. Conference Proceedings.

[51]  Christoph M. Hoffmann,et al.  Correctness proof of a geometric constraint solver , 1996, Int. J. Comput. Geom. Appl..

[52]  Alejandro M. García-Alonso,et al.  Solving the collision detection problem , 1994, IEEE Computer Graphics and Applications.

[53]  Yong Wang,et al.  A Virtual Assembly Design Environment , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[54]  Ronald Fedkiw,et al.  Nonconvex rigid bodies with stacking , 2003, ACM Trans. Graph..

[55]  Christoph M. Hoffmann,et al.  A graph-constructive approach to solving systems of geometric constraints , 1997, TOGS.

[56]  J. C. Owen,et al.  Algebraic solution for geometry from dimensional constraints , 1991, SMA '91.

[57]  John Simmons,et al.  The generation and practical use of plans for manual assembly using immersive virtual reality , 1999 .

[58]  Bert Bras,et al.  Collision Detection for Virtual Objects in a Haptic Assembly and Disassembly Simulation Environment , 2002 .

[59]  Grigore C. Burdea,et al.  The Rutgers Master II-ND force feedback glove , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[60]  Terrence Fernando,et al.  An Immersive Assembly and Maintenance Simulation Environment , 2004, Eighth IEEE International Symposium on Distributed Simulation and Real-Time Applications.

[61]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[62]  Bert Bras,et al.  A Haptic Assembly and Disassembly Simulation Environment and Associated Computational Load Optimization Techniques , 2001, J. Comput. Inf. Sci. Eng..

[63]  Dinesh Manocha,et al.  CULLIDE: interactive collision detection between complex models in large environments using graphics hardware , 2003, HWWS '03.

[64]  Judy M. Vance,et al.  Effectiveness of Haptic Sensation for the Evaluation of Virtual Prototypes , 2001, J. Comput. Inf. Sci. Eng..

[65]  Uma Jayaram,et al.  CORBA-Based Collaboration in a Virtual Assembly Design Environment , 2009 .

[66]  Steve Bryson.  Virtual reality in scientific visualization , 1993, Comput. Graph..

[67]  David Baraff,et al.  Curved surfaces and coherence for non-penetrating rigid body simulation , 1990, SIGGRAPH.

[68]  Judy M. Vance,et al.  Development of a Networked Haptic Environment in VR to Facilitate Collaborative Design Using Voxmap Pointshell (VPS) Software , 2004 .

[69]  John Simmons,et al.  A methodology for eliciting expert knowledge in virtual engineering environments , 1999, PICMET '99: Portland International Conference on Management of Engineering and Technology. Proceedings Vol-1: Book of Summaries (IEEE Cat. No.99CH36310).

[70]  Christoph M. Hoffmann.  D-Cubed's Dimensional Constraint Manager , 2001, J. Comput. Inf. Sci. Eng..

[71]  Christoph M. Hoffmann,et al.  Geometric constraint solver , 1995, Comput. Aided Des..

[72]  Xiaowu Chen,et al.  A virtual environment for collaborative assembly , 2005, Second International Conference on Embedded Software and Systems (ICESS'05).

[73]  Judy M. Vance,et al.  SHARP: A System for Haptic Assembly and Realistic Prototyping , 2006 .

[74]  Maxine D. Brown,et al.  The ImmersaDesk and Infinity Wall projection-based virtual reality displays , 1997, COMG.

[75]  Pat P. Banerjee.  Data Interface Software for Windows PC-compatible Virtual Reality Scene Graphs , 2002, J. Comput. Inf. Sci. Eng..

[76]  Judy M. Vance,et al.  Using VPS (VoxMap Pointshell) as the Basis for Interaction in a Virtual Assembly Environment , 2003 .

[77]  David Baraff,et al.  Analytical methods for dynamic simulation of non-penetrating rigid bodies , 1989, SIGGRAPH.

[78]  Guozhong Dai,et al.  MIVAS: A Multi-Modal Immersive Virtual Assembly System , 2004 .

[79]  Grigore C. Burdea,et al.  Invited review: the synergy between virtual reality and robotics , 1999, IEEE Trans. Robotics Autom..

[80]  Bernd Fröhlich,et al.  The Responsive Workbench [virtual work environment] , 1994, IEEE Computer Graphics and Applications.

[81]  Scott Daniel McDermott,et al.  Development of a haptically enabled disassembly simulation environment , 1999 .

[82]  Samir Garbaya,et al.  The affect of contact force sensations on user performance in virtual assembly tasks , 2007, Virtual Reality.

[83]  Ming C. Lin,et al.  Accurate and Fast Proximity Queries Between Polyhedra Using Convex Surface Decomposition , 2001, Comput. Graph. Forum.

[84]  Jing-Rong Li,et al.  A CAD-linked virtual assembly environment , 2006 .

[85]  Judy M. Vance,et al.  The Use of the Voxmap Pointshell Method of Collision Detection in Virtual Assembly Methods Planning , 2001 .

[86]  Grigore C. Burdea,et al.  Haptics issues in virtual environments , 2000, Proceedings Computer Graphics International 2000.

[87]  Judy M. Vance,et al.  Assessment of VR Technology and its Applications to Engineering Problems , 2001, J. Comput. Inf. Sci. Eng..

[88]  R. Light,et al.  Modification of geometric models through variational geometry , 1982 .

[89]  Pixar Animation Studios,et al.  Physically Based Modeling , 2001 .

[90]  Ying Zhang,et al.  The use of visual and auditory feedback for assembly task performance in a virtual environment , 2005, Ninth International Conference on Information Visualisation (IV'05).

[91]  Diego Borro,et al.  Collision problem: characteristics for a taxonomy , 2005, Ninth International Conference on Information Visualisation (IV'05).

[92]  H. J. Bullinger,et al.  Virtual assembly planning , 2000 .

[93]  Ming C. Lin,et al.  Collision Detection between Geometric Models: A Survey , 1998 .

[94]  Bert Bras,et al.  An Experiment on Weight Sensation in Real and Virtual Environments , 2004 .