Interactive evaluation of assembly sequences using augmented reality

This paper describes an interactive tool for evaluating assembly sequences using the novel human-computer interface of augmented reality. The goal is to be able to consider various sequencing alternatives of the manufacturing design process by manipulating both virtual and real prototype components. The augmented reality-based assembly evaluation tool would allow a manufacturing engineer to interact with the assembly planner while manipulating the real and virtual prototype components in an assembly environment. Information from the assembly planner can be displayed directly superimposed on the real. A sensing technique is proposed that uses computer vision along with a system of markers for automatically monitoring the assembly state as the user manipulates the assembly components. An implemented system called AREAS is described. The advantage of using mixed prototyping and augmented reality as means of capturing human intuition in assembly planning is also discussed.

[1]  Thomas L. DeFazio,et al.  An integrated computer aid for generating and evaluating assembly sequences for mechanical products , 1991, IEEE Trans. Robotics Autom..

[2]  D. Strip,et al.  Archimedes : An experiment in automating mechanical assembly , 1990 .

[3]  Man-Cheung Max Lui.  Generation and evaluation of mechanical assembly sequences using the liaison-sequence method , 1988 .

[4]  Ryutarou Ohbuchi,et al.  Merging virtual objects with the real world: seeing ultrasound imagery within the patient , 1992, SIGGRAPH.

[5]  Russell H. Taylor,et al.  The synthesis of manipulator control programs from task-level specifications , 1976 .

[6]  Arthur C. Sanderson,et al.  AND/OR graph representation of assembly plans , 1986, IEEE Trans. Robotics Autom..

[7]  Ronald Azuma,et al.  Tracking requirements for augmented reality , 1993, CACM.

[8]  Arthur C. Sanderson,et al.  A correct and complete algorithm for the generation of mechanical assembly sequences , 1991, IEEE Trans. Robotics Autom..

[9]  Rakesh Gupta,et al.  Experiments Using Multimodal Virtual Environments in Design for Assembly Analysis , 1997, Presence: Teleoperators & Virtual Environments.

[10]  Scott S. Fisher,et al.  Defining, modeling, and measuring system lag in virtual environments , 1990, Other Conferences.

[11]  Geoffrey Boothroyd,et al.  Product design for manufacture and assembly , 1994, Comput. Aided Des..

[12]  Mark A. Livingston,et al.  Superior augmented reality registration by integrating landmark tracking and magnetic tracking , 1996, SIGGRAPH.

[13]  Randall H. Wilson.  Minimizing user queries in interactive assembly planning , 1995, IEEE Trans. Robotics Autom..

[14]  Rajeev Sharma,et al.  Computer vision based augmented reality for guiding and evaluating assembly sequences , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[15]  Camille Goudeseune,et al.  Model based interactive sound for an immersive virtual environment , 1994, ICMC.

[16]  R.H. Wilson,et al.  On constraints in assembly planning , 1998, IEEE Trans. Robotics Autom..

[17]  Matthias M. Wloka,et al.  Resolving occlusion in augmented reality , 1995, I3D '95.

[18]  S.J. Rhee,et al.  A design-specific approach to design-for-assembly (DFA) for complex mechanical assemblies , 1997, Proceedings of the 1997 IEEE International Symposium on Assembly and Task Planning (ISATP'97) - Towards Flexible and Agile Assembly and Manufacturing -.

[19]  Rajeev Sharma,et al.  Computer Vision-Based Augmented Reality for Guiding Manual Assembly , 1997, Presence: Teleoperators & Virtual Environments.

[20]  Tomás Lozano-Pérez,et al.  Assembly sequencing for arbitrary motions , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[21]  Thomas L. DeFazio,et al.  Simplified generation of all mechanical assembly sequences , 1987, IEEE Journal on Robotics and Automation.

[22]  Steven K. Feiner,et al.  Knowledge-based augmented reality , 1993, CACM.

[23]  Damian M. Lyons,et al.  Assembly and task planning: a taxonomy , 1994, IEEE Robotics & Automation Magazine.

[24]  Maria Jog.  Minimal Infeasible Sets of Connections: A Representation for Efficient Assembly Sequence Planning , 1997 .

[25]  FuchsHenry,et al.  Merging virtual objects with the real world , 1992 .

[26]  Rajeev Sharma,et al.  A framework for robot motion planning with sensor constraints , 1997, IEEE Trans. Robotics Autom..

[27]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[28]  David E. Breen,et al.  Calibration Requirements and Procedures for a Monitor-Based Augmented Reality System , 1995, IEEE Trans. Vis. Comput. Graph..

[29]  Randall H. Wilson,et al.  Lessons learned from a second generation assembly planning system , 1995, Proceedings. IEEE International Symposium on Assembly and Task Planning.

[30]  Daniel E. Whitney,et al.  Aids for the design or choice of assembly sequences , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.