In-Situ Support for Automotive Manufacturing Using Spatial Augmented Reality

In automotive manufacturing, quality inspection of spot welding demands excessive manual operations. Operators refer to a printed drawing of the testing body, with the inspection points marked on this drawing. Operators have to locate the matching spot on the drawing and the body manually to perform the inspection. Further more, different subsets of spots are inspected on different car bodies with a pre-determined sequence. This paper describes a system that projects visual data onto arbitrary surfaces for providing just-in-time information to a user in-situ within a physical work-cell. This system aims to reduce the inefficiencies and potential mistakes in manual inspection process. This paper discusses how spatial augmented reality and head-mount displays may be combined to display global information visible by all operators as well as personalized information to individuals. Further investigations on applying spatial augmented reality for spot welding inspections are explored, including four types of digital information projected onto the surfaces of car body parts under structured work environments: 1) Location of spot welds; 2) Inspection methods; 3) Operation Description Sheet (ODS) information; 4) Visualization of weld locating methods. Three visualization methods are used to attract operators’ attention to locate the position of spot welds efficiently. This paper also proposes a method to project augmentations on objects moving along an assembly line. The proposed system allows operators becoming more effective and efficient in performing proper inspections, by providing them the required information at the required time without the need to refer to paper-based manuals or computer terminals.

[1]  Gudrun Klinker,et al.  Using laser projectors for augmented reality , 2008, VRST '08.

[2]  Takeo Kanade,et al.  Projector Calibration using Arbitrary Planes and Calibrated Camera , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[4]  Masahiko Inami,et al.  Augmented coliseum: an augmented game environment with small vehicles , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[5]  Gudrun Klinker,et al.  An Augmented Reality Laser Projector using Marker-less Tracking , 2008 .

[6]  Björn Schwerdtfeger,et al.  Pick-by-vision: bringing HMD-based augmented reality into the warehouse , 2012 .

[7]  Ross T. Smith,et al.  Validating Spatial Augmented Reality for interactive rapid prototyping , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[8]  Dieter Schmalstieg,et al.  Mobile collaborative augmented reality , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[9]  Luc Soler,et al.  An augmented reality system for liver thermal ablation: Design and evaluation on clinical cases , 2009, Medical Image Anal..

[10]  Greg Welch,et al.  Spatially augmented reality , 1999 .

[11]  Carlo Tomasi,et al.  How to rotate a camera , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[12]  Didier Stricker,et al.  Augmented reality for construction tasks: doorlock assembly , 1999 .

[13]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[14]  Alex Olwal,et al.  Spatial augmented reality on industrial CNC-machines , 2008, Electronic Imaging.

[15]  Holger Regenbrecht,et al.  Augmented reality projects in the automotive and aerospace industries , 2005, IEEE Computer Graphics and Applications.

[16]  Bruce H. Thomas,et al.  A wearable computer system with augmented reality to support terrestrial navigation , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[17]  Bruce H. Thomas,et al.  The Tinmith System - Demonstrating New Techniques for Mobile Augmented Reality Modelling , 2002, AUIC.

[18]  Scott E. Hudson,et al.  Moveable interactive projected displays using projector based tracking , 2005, UIST.

[19]  Michitaka Hirose,et al.  Projected augmentation - augmented reality using rotatable video projectors , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[20]  Bruce H. Thomas,et al.  Augmented foam sculpting for capturing 3D models , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[21]  Oliver Bimber,et al.  Superimposing pictorial artwork with projected imagery , 2005, IEEE MultiMedia.

[22]  Gudrun Klinker,et al.  Hybrid Information Presentation: Combining a Portable Augmented Reality Laser Projector and a Conventional Computer Display , 2007, EGVE.

[23]  J. Debus,et al.  Projector-based augmented reality for intuitive intraoperative guidance in image-guided 3D interstitial brachytherapy. , 2008, International journal of radiation oncology, biology, physics.

[24]  Ramesh Raskar,et al.  Modern approaches to augmented reality , 2005, SIGGRAPH Courses.