Visualisation Techniques for Using Spatial Augmented Reality in the Design Process of a Car

If spatial augmented reality is used in the design process of a car, then one of the most important issues is that the virtual content is projected with a very high visual quality onto the real object, because based on this projection design decisions are made. Especially, the visualised colours on the real object should not be distinguishable from corresponding real reference colours. In this paper, we introduce a new approach for the augmentation of real objects which is able to match the requirements of a design process. We present a new rendering method with ray tracing which increases the visual quality of the projection images in comparison to existing methods. The desired values of these images have further to be adjusted according to the material, the ambient light and the local orientation of the projector. For this purpose, we develop a physically based computation which exactly determines the corresponding projection intensities for these values by using three‐dimensional lookup tables at every projector pixel. Since not all of the desired values can be represented with an intensity of the projector, an adjustment has to be computed for these values. Therefore, we conduct a user study with design experts who work in the automotive industry and use the results to propose a new adjustment method for such values. Finally, we compare our methods to existing procedures and conclude which ones are suitable for the design process of a car.

[1]  T. Yoshida,et al.  A Virtual Color Reconstruction System for Real Heritage with Light Projection , 2003 .

[2]  Shree K. Nayar,et al.  A Projection System with Radiometric Compensation for Screen Imperfections , 2003 .

[3]  Gaurav Sharma,et al.  Digital color imaging , 1997, IEEE Trans. Image Process..

[4]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[5]  Oliver Bimber,et al.  Real-Time Adaptive Radiometric Compensation , 2006, IEEE Transactions on Visualization and Computer Graphics.

[6]  Daniel G. Aliaga,et al.  A virtual restoration stage for real-world objects , 2008, SIGGRAPH Asia '08.

[7]  Stefan Müller,et al.  Spatial Color Confidence for Physically based Rendering Settings on LC Displays , 2010, GRAPP.

[8]  Takahiro Okabe,et al.  Radiometric Compensation in a Projector-Camera System Based Properties of Human Vision System , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[9]  Eric Li,et al.  Dynamic projection environments for immersive visualization , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[10]  Oliver Bimber,et al.  Embedded Entertainment with Smart Projectors , 2005, Computer.

[11]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[12]  Reinhard Koch,et al.  Physically-based augmentation of real objects with virtual content under the influence of ambient light , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[13]  Oliver Bimber,et al.  Superimposing pictorial artwork with projected imagery , 2005, IEEE MultiMedia.

[14]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[15]  Gordon Wetzstein,et al.  The Visual Computing of Projector‐Camera Systems , 2008, SIGGRAPH '08.

[16]  Oliver Bimber,et al.  Embedded entertainment with smart projectors , 2005, Computer.

[17]  Jon Y. Hardeberg,et al.  An inverse display color characterization model based on an optimized geometrical structure , 2008, Electronic Imaging.

[18]  Barbara Cutler,et al.  Global Illumination Compensation for Spatially Augmented Reality , 2010, Comput. Graph. Forum.

[19]  Ruigang Yang,et al.  Reducing resolution loss in two-pass rendering by optimal view directions and display-surface partitioning , 2008, PROCAMS '08.

[20]  Gordon Wetzstein,et al.  Radiometric Compensation through Inverse Light Transport , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[21]  Jyh-Ming Lien Point-Based Minkowski Sum Boundary , 2007, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[22]  Mark Ashdown,et al.  Robust Content-Dependent Photometric Projector Compensation , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[23]  Reinhard Koch,et al.  Evaluation of Geometric Registration Methods for Using Spatial Augmented Reality in the Automotive Industry , 2010, VMV.