Dynamic Spatially Augmented 3D Painting

We presenttechniquesfor creatinga SpatiallyAugmentedReality for moving polygonalobjectsin an indoor environment,anda systemthat usesthesetechniquesfor painting in 3D on theseobjects in real time. By tracking theobjectandprojectingon its different surfaceswith twoor moreprojectors,our systemcreatesa dynamic spatiallyaugmentedversionof theobjectthat is registeredwith the realobjectasit moves.Alongwith modificationof thelighting and material properties,our applicationallows real-time3D painting onthesurfaceof therealobject.Eventhoughextensiveuserstudies for this applicationhavenot yetbeendone, theapplicationis new andcompellingenoughevenat theproof of conceptstage to warrant further exploration into this area to solveall of the problems encounter ed,particularly into theproblemof real-timeblendingof theprojectedimagesin theareasof projectoroverlap.

[1]  Donald Meagher,et al.  Geometric modeling using octree encoding , 1982, Comput. Graph. Image Process..

[2]  Ronald Azuma,et al.  Improving static and dynamic registration in an optical see-through HMD , 1994, SIGGRAPH.

[3]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[4]  John S. Montrym,et al.  InfiniteReality: a real-time graphics system , 1997, SIGGRAPH.

[5]  Greg Welch,et al.  SCAAT: incremental tracking with incomplete information , 1997, SIGGRAPH.

[6]  Peter-Pike J. Sloan,et al.  Importance Driven Texture Coordinate Optimization , 1998, Comput. Graph. Forum.

[7]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[8]  S. Marschner,et al.  Inverse Rendering for Computer Graphics , 1998 .

[9]  Dinesh Manocha,et al.  Fast Proximity Queries with Swept Sphere Volumes , 1999 .

[10]  Greg Welch,et al.  The HiBall Tracker: high-performance wide-area tracking for virtual and augmented environments , 1999, VRST '99.

[11]  Greg Welch,et al.  Table-top spatially-augmented realty: bringing physical models to life with projected imagery , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[12]  Greg Welch,et al.  Spatially augmented reality , 1999 .

[13]  Wolfgang Stuerzlinger,et al.  Imaging all Visible Surfaces , 1999, Graphics Interface.

[14]  Ming C. Lin,et al.  inTouch: interactive multiresolution modeling and 3D painting with a haptic interface , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[15]  Dinesh Manocha,et al.  Collision queries using oriented bounding boxes , 2000 .

[16]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.