Virtual Heliodon: Spatially Augmented Reality for Architectural Daylighting Design

We present an application of interactive global illumination and spatially augmented reality to architectural daylight modeling that allows designers to explore alternative designs and new technologies for improving the sustainability of their buildings. Images of a model in the real world, captured by a camera above the scene, are processed to construct a virtual 3D model. To achieve interactive rendering rates, we use a hybrid rendering technique, leveraging radiosity to simulate the inter-reflectance between diffuse patches and shadow volumes to generate per-pixel direct illumination. The rendered images are then projected on the real model by four calibrated projectors to help users study the daylighting illumination. The virtual heliodon is a physical design environment in which multiple designers, a designer and a client, or a teacher and students can gather to experience animated visualizations of the natural illumination within a proposed design by controlling the time of day, season, and climate. Furthermore, participants may interactively redesign the geometry and materials of the space by manipulating physical design elements and see the updated lighting simulation.

[1]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[2]  F. Raab,et al.  Magnetic Position and Orientation Tracking System , 1979, IEEE Transactions on Aerospace and Electronic Systems.

[3]  Frédo Durand,et al.  Implicit visibility and antiradiance for interactive global illumination , 2007, ACM Trans. Graph..

[4]  Greg Welch,et al.  Animating Real Objects With Image-Based Illumination , 2001 .

[5]  A. Fournier,et al.  Common Illumination between Real and Computer Generated Scenes , 1992 .

[6]  Donald P. Greenberg,et al.  Modeling the interaction of light between diffuse surfaces , 1984, SIGGRAPH.

[7]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[8]  Simon Gibson,et al.  Interactive Rendering with Real-World Illumination , 2000, Rendering Techniques.

[9]  Mark Ashdown,et al.  A flexible projector-camera system for multi-planar displays , 2004, CVPR 2004.

[10]  Claudio S. Pinhanez.  The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces , 2001, UbiComp.

[11]  Hans-Peter Seidel,et al.  A CAVE system for interactive modeling of global illumination in car interior , 2004, VRST '04.

[12]  Oliver Bimber,et al.  Real-Time Adaptive Radiometric Compensation , 2006, IEEE Transactions on Visualization and Computer Graphics.

[13]  Mark Ashdown,et al.  A flexible projector-camera system for multi-planar displays , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[14]  Phillip S. Dunston,et al.  An Immersive Virtual Reality Mock-Up for Design Review of Hospital Patient Rooms , 2011, Collaborative Design in Virtual Environments.

[15]  Markus Gross,et al.  The Blue-C Integrating Real Humans into a Networked Immersive Environment , 2000 .

[16]  Shree K. Nayar,et al.  Light field transfer: global illumination between real and synthetic objects , 2008, SIGGRAPH 2008.

[17]  Ramesh Raskar,et al.  Automatic projector calibration with embedded light sensors , 2004, UIST '04.

[18]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[19]  Rahul Sukthankar,et al.  Smarter Presentations: Exploiting Homography in Camera-Projector Systems , 2001, ICCV.

[20]  G. W. Larson,et al.  Rendering with radiance - the art and science of lighting visualization , 2004, Morgan Kaufmann series in computer graphics and geometric modeling.

[21]  Rahul Sukthankar,et al.  Smarter presentations: exploiting homography in camera-projector systems , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[22]  George Drettakis,et al.  Interactive Common Illumination for Computer Augmented Reality , 1997, Rendering Techniques.

[23]  Christine D. Piatko,et al.  A visibility matching tone reproduction operator for high dynamic range scenes , 1997 .

[24]  Paul F. Whelan,et al.  Which pattern? Biasing aspects of planar calibration patterns and detection methods , 2007, Pattern Recognit. Lett..

[25]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[26]  Christoph F. Reinhart,et al.  DAYLIGHT1-2-3 - A STATE-OF-THE-ART DAYLIGHTING/ENERGY ANALYSIS SOFTWARE FOR INITIAL DESIGN INVESTIGATIONS , 2007 .

[27]  Leon R. Glicksman,et al.  Rapid algorithm for modeling daylight distributions in office buildings , 2007 .

[28]  Sanjit K. Mitra,et al.  Using saddle points for subpixel feature detection in camera calibration targets , 2002, Asia-Pacific Conference on Circuits and Systems.

[29]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[31]  Ramesh Raskar,et al.  Cartoon dioramas in motion , 2002, NPAR '02.

[32]  Paul A. Beardsley,et al.  Interaction using a handheld projector , 2005, IEEE Computer Graphics and Applications.

[33]  Jan Kautz,et al.  Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments , 2002 .

[34]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[35]  Tony DeRose,et al.  Mesh optimization , 1993, SIGGRAPH.

[36]  Mark Stanley Rea,et al.  The IESNA lighting handbook : reference & application , 2000 .

[37]  Ellen Yi-Luen Do,et al.  SPOT! Fetch Light Interactive navigable 3D visualization of direct sunlight , 2003 .

[38]  Sumanta N. Pattanaik,et al.  Interactive global illumination in dynamic environments using commodity graphics hardware , 2003, 11th Pacific Conference onComputer Graphics and Applications, 2003. Proceedings..

[39]  Paul A. Beardsley,et al.  A self-correcting projector , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[40]  Sumanta N. Pattanaik,et al.  Radiance cache splatting: a GPU-friendly global illumination algorithm , 2005, EGSR '05.

[41]  Dong Hoon Lee,et al.  Extensible Interface Using Projector-Based Augmentation , 2006, CGVR.

[42]  Hiroshi Ishii,et al.  Emancipated pixels: real-world graphics in the luminous room , 1999, SIGGRAPH.

[43]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).