Physics-based virtual reality for task learning and intelligent disassembly planning

Physics-based simulation is increasingly important in virtual manufacturing for product assembly and disassembly operations. This work explores potential benefits of physics-based modeling for automatic learning of assembly tasks and for intelligent disassembly planning in desktop virtual reality. The paper shows how realistic physical animation of manipulation tasks can be exploited for learning sequential constraints from user demonstrations. In particular, a method is proposed where information about physical interaction is used to discover task precedences and to reason about task similarities. A second contribution of the paper is the application of physics-based modeling to the problem of disassembly sequence planning. A novel approach is described to find all physically admissible subassemblies in which a set of rigid objects can be disassembled. Moreover, efficient strategies are presented aimed at reducing the computational time required for automatic disassembly planning. The proposed strategies take into account precedence relations arising from user assembly demonstrations as well as geometrical clustering. A motion planning technique has also been developed to generate non-destructive disassembly paths in a query-based approach. Experiments have been performed in an interactive virtual environment including a dataglove and motion tracker that allows realistic object manipulation and grasping.

[1]  Katsushi Ikeuchi,et al.  Estimation of essential interactions from multiple demonstrations , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[2]  Zita Vale,et al.  Analysis of the complexity of precedence graphs for assembly and task planning , 1997, Proceedings of the 1997 IEEE International Symposium on Assembly and Task Planning (ISATP'97) - Towards Flexible and Agile Assembly and Manufacturing -.

[3]  Michitaka Hirose,et al.  Dexterous object manipulation based on collision response , 2003, IEEE Virtual Reality, 2003. Proceedings..

[4]  Rüdiger Dillmann,et al.  Learning sequential constraints of tasks from user demonstrations , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[5]  Stefano Caselli,et al.  On the potential of physics-based animation for task programming in virtual reality , 2009, 2009 IEEE International Conference on Robotics and Automation.

[6]  Jean-Claude Latombe,et al.  A general framework for assembly planning: the motion space approach , 1998, SCG '98.

[7]  Nancy M. Amato,et al.  Disassembly sequencing using a motion planning approach , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[8]  S. Lee,et al.  Subassembly stability and reorientation , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[9]  Rüdiger Dillmann,et al.  Towards Cognitive Robots: Building Hierarchical Task Representations of Manipulations from Human Demonstration , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[10]  P.K. Khosla,et al.  Subassembly identification and motion generation for assembly: a geometric approach , 1990, 1990 IEEE International Conference on Systems Engineering.

[11]  Miguel Ángel García,et al.  Hierarchical clustering of 3D objects and its application to minimum distance computation , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[12]  Juan CortL Disassembly Path Planning for Complex Articulated Objects , 2008 .

[13]  Sukhan Lee,et al.  Physical reasoning of interconnection forces for efficient assembly planning , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[14]  Ke Chen,et al.  Systematic generation of assembly precedence graphs , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[15]  N. S. Ong,et al.  Automatic Subassembly Detection from a Product Model for Disassembly Sequence Generation , 1999 .

[16]  Friedrich M. Wahl,et al.  Stability analysis of assemblies considering friction , 1997, IEEE Trans. Robotics Autom..

[17]  Theodore Lim,et al.  Assembly planning and motion study using virtual reality , 2009 .

[18]  Michael F. Zaeh,et al.  Haptic Interaction with a Glove Interface in a Physics Based Virtual Environment , 2004 .

[19]  Yong Wang,et al.  VADE: A Virtual Assembly Design Environment , 1999, IEEE Computer Graphics and Applications.

[20]  Rafael Aracil,et al.  Disassembly Planning Based on Precedence Relations among Assemblies , 2003 .

[21]  Sukhan Lee Subassembly identification and evaluation for assembly planning , 1994, IEEE Trans. Syst. Man Cybern..

[22]  Christoph W. Borst,et al.  Realistic virtual grasping , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[23]  Stefano Caselli,et al.  Robot grasp synthesis from virtual demonstration and topology-preserving environment reconstruction , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Jinxiang Dong,et al.  A hierarchical approach to disassembly sequence planning for mechanical product , 2006 .

[25]  Tomoichi Takahashi,et al.  Robotic assembly operation teaching in a virtual environment , 1994, IEEE Trans. Robotics Autom..

[26]  Yang Luo,et al.  Realistic virtual hand modeling with applications for virtual grasping , 2004, VRCAI '04.

[27]  Willem F. Bronsvoort,et al.  A semi-automatic assembly sequence planner , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[28]  Arthur C. Sanderson,et al.  AND/OR graph representation of assembly plans , 1986, IEEE Trans. Robotics Autom..

[29]  Pradeep K. Khosla,et al.  Finding all stable orientations of assemblies with friction , 1996, IEEE Trans. Robotics Autom..

[30]  Samir Garbaya,et al.  The affect of contact force sensations on user performance in virtual assembly tasks , 2007, Virtual Reality.

[31]  M. Bergamasco,et al.  A realistic approach for grasping and moving virtual objects , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[32]  Judy M. Vance,et al.  Desktop haptic virtual assembly using physically based modelling , 2007, Virtual Reality.

[33]  Katsushi Ikeuchi,et al.  Toward an assembly plan from observation. I. Task recognition with polyhedral objects , 1994, IEEE Trans. Robotics Autom..

[34]  Diego Borro,et al.  Parallel RRT-based path planning for selective disassembly planning , 2008 .

[35]  Devin J. Balkcom,et al.  Computation reuse for rigid-body dynamics , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  Rajit Gadh,et al.  Virtual disassembly-a software tool for developing product dismantling and maintenance systems , 1998, Annual Reliability and Maintainability Symposium. 1998 Proceedings. International Symposium on Product Quality and Integrity.

[37]  Theodore Lim,et al.  Factors affecting user performance in haptic assembly , 2007, Virtual Reality.