Projector-based three dimensional graphics

Ramesh Raskar Projector-based Three Dimensional Graphics (Under the direction of Henry Fuchs and Gregory Welch) Light projectors can be arranged into electronic displays that offer large, bright, and high resolution images. However, despite their unique characteristics, projectors have been treated like any other two-dimensional display devices, e.g. CRT monitors or LCD panels, to create flat and usually rectangular images. Even the growth of three dimensional computer graphics has followed this limitation. To improve and widen the range of applications of projectors, in this dissertation I present a single unified geometric framework for projector-based graphics. It is based on the notion of the projector as the dual of a camera. The geometric framework is based on (i) the analytical projection model, (ii) the geometric representation of the display surface and (iii) the viewer location. The framework can be used for practically all the projector-based applications. For classic projectorbased systems, such as tiled displays or immersive panoramic displays, the framework provides a fundamentally different approach that allows greater freedom and flexibility. In addition, it enables a new class of projector-based visualization methods.

[1]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[2]  Greg Welch,et al.  SCAAT: incremental tracking with incomplete information , 1997, SIGGRAPH.

[3]  Maxine D. Brown,et al.  The ImmersaDesk and Infinity Wall projection-based virtual reality displays , 1997, COMG.

[4]  Greg Welch,et al.  Working in the Office of "Real Soon Now" , 2000, IEEE Computer Graphics and Applications.

[5]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[6]  Lance Williams,et al.  View interpolation for image synthesis , 1998 .

[7]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[8]  Sing Bing Kang,et al.  Survey of image-based rendering techniques , 1998, Electronic Imaging.

[9]  Donald P. Greenberg,et al.  Design and simulation of opera lighting and projection effects , 1991, SIGGRAPH.

[10]  Ruigang Yang,et al.  PixelFlex: a reconfigurable multi-projector display system , 2001, Proceedings Visualization, 2001. VIS '01..

[11]  Ramesh Raskar,et al.  Immersive planar display using roughly aligned projectors , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[12]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[13]  Tony DeRose,et al.  Toolglass and magic lenses: the see-through interface , 1993, SIGGRAPH.

[14]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[15]  Greg Welch,et al.  Efficient Image Generation for Multiprojector and Multisurface Displays , 1998, Rendering Techniques.

[16]  Adam Finkelstein,et al.  Building and Using A Scalable Display Wall System , 2000, IEEE Computer Graphics and Applications.

[17]  Gordon Stoll,et al.  Lightning-2: a high-performance display subsystem for PC clusters , 2001, SIGGRAPH.

[18]  Gordon Stoll,et al.  WireGL: a scalable graphics system for clusters , 2001, SIGGRAPH.

[19]  Markus Gross,et al.  The Blue-C Integrating Real Humans into a Networked Immersive Environment , 2000 .

[20]  Bernd Fröhlich,et al.  The two-user Responsive Workbench: support for collaboration through individual views of a shared space , 1997, SIGGRAPH.

[21]  Richard Szeliski,et al.  Video mosaics for virtual environments , 1996, IEEE Computer Graphics and Applications.

[22]  Wolfgang Stuerzlinger,et al.  Imaging all Visible Surfaces , 1999, Graphics Interface.

[23]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[24]  George Wolberg,et al.  Digital image warping , 1990 .

[25]  Kok-Lim Low,et al.  Blending multiple views , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[26]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[27]  Ian D. Reid,et al.  Duality, Rigidity and Planar Parallax , 1998, ECCV.

[28]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[29]  Kai Li,et al.  Optical blending for multi-projector display wall systems , 1999, 1999 IEEE LEOS Annual Meeting Conference Proceedings. LEOS'99. 12th Annual Meeting. IEEE Lasers and Electro-Optics Society 1999 Annual Meeting (Cat. No.99CH37009).

[30]  D Marr,et al.  A computational theory of human stereo vision. , 1979, Proceedings of the Royal Society of London. Series B, Biological sciences.

[31]  Howard Rheingold,et al.  Virtual Reality , 1991 .

[32]  Heung-Yeung Shum,et al.  Panoramic Image Mosaics , 1998 .

[33]  Hiroshi Ishii,et al.  Emancipated pixels: real-world graphics in the luminous room , 1999, SIGGRAPH.

[34]  JeroenvanBaar RameshRaskar,et al.  A Low-Cost Projector Mosaic with Fast Registration , 2002 .

[35]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[36]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[37]  Ramesh Raskar,et al.  A Low-Cost Projector Mosaic with Fast Registration , 2002 .

[38]  Claudio S. Pinhanez.  Using a steerable projector and a camera to transform surfaces into interactive displays , 2001, CHI Extended Abstracts.

[39]  Greg Welch,et al.  Real-time depth warping for 3-D scene reconstruction , 1999, 1999 IEEE Aerospace Conference. Proceedings (Cat. No.99TH8403).

[40]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[41]  Michael S. Brown,et al.  Projected Imagery in Your "Office of the Future" , 2000, IEEE Computer Graphics and Applications.

[42]  Harpreet S. Sawhney,et al.  True Multi-Image Alignment and Its Application to Mosaicing and Lens Distortion Correction , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[44]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[45]  Paul A. Beardsley,et al.  A self-correcting projector , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[46]  W. Brent Seales,et al.  Dynamic shadow removal from front projection displays , 2001, Proceedings Visualization, 2001. VIS '01..

[47]  Greg Welch,et al.  Toward a compelling sensation of telepresence: demonstrating a portal to a distant (static) office , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[48]  Nelson Max,et al.  SIGGRAPH '84 call for Omnimax Films , 1983, COMG.

[49]  Rajeev Sharma,et al.  Toward Natural Gesture/Speech Control of a Large Display , 2001, EHCI.

[50]  Philipp Slusallek,et al.  Wide area camera calibration using virtual calibration objects , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[51]  Robert F. Sproull,et al.  Principles in interactive computer graphics , 1973 .

[52]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[53]  Ramesh Raskar.  Hardware support for non-photorealistic rendering , 2001, HWWS '01.

[54]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[55]  J. O'Rourke.  Art gallery theorems and algorithms , 1987 .

[56]  Pat Hanrahan,et al.  A distributed graphics system for large tiled displays , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[57]  Frank Nielsen,et al.  Hypermask talking head projected onto real object , 2000 .

[58]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[59]  Greg Welch,et al.  COMPUTER GRAPHICS OPTIQUE Optical Superposition of Projected Computer Graphics , 2001, EGVE/IPT.

[60]  Markus Gross,et al.  The Blue-C , 2000 .

[61]  W. Brent Seales,et al.  Multi-projector displays using camera-based registration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[62]  Anselmo Lastra,et al.  Life-sized projector-based dioramas , 2001, VRST '01.

[63]  Harpreet S. Sawhney,et al.  True multi-image alignment and its application to mosaicing and lens distortion correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[64]  Ed Lantz,et al.  The future of virtual reality: head mounted displays versus spatially immersive displays (panel) , 1996, SIGGRAPH.

[65]  Hiroshi Ishii,et al.  Illuminating clay: a 3-D tangible interface for landscape analysis , 2002, CHI.

[66]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[67]  Wolfgang Knoll,et al.  Architectural Models: Construction Techniques , 1992 .

[68]  Paul A. Beardsley,et al.  Tangible interaction + graphical interpretation: a new approach to 3D modeling , 2000, SIGGRAPH.

[69]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[70]  Rajeev J. Surati.  Scalable self-calibrating display technology for seamless large-scale displays , 1999 .

[71]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[72]  Xing Chen,et al.  Lumipoint: multi-user laser-based interaction on large tiled displays , 2002 .

[73]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[74]  Ramesh Raskar,et al.  Dynamic Shader Lamps: Painting on Real Objects , 2001 .

[75]  Takeo Kanade,et al.  Virtual Space Teleconferencing Using a Sea of Cameras , 1994 .

[76]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[77]  Greg Welch,et al.  Spatially augmented reality , 1999 .

[78]  Thomas A. Funkhouser,et al.  Load balancing for multi-projector rendering systems , 1999, Workshop on Graphics Hardware.

[79]  Gita Reese Sukthankar,et al.  Dynamic shadow elimination for multi-projector displays , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.