Instant relighting of volumetric data

During the visualization of volume data, changing the illumination condition provides us a way to reveal and emphasize the local structures within the volume. However, volume rendering with real-time lighting control is hard. It requires the re-computation of the amount of light received at each voxel after the attenuation, whenever the user changes the lighting condition. In this paper, we describe an image-based approach to relight (change the illumination) the volume in real time. The nature of image-based rendering decouples the rendering time complexity from the resolution of volume data. Hence, real-time relighting of volumetric data is possible even shadow (attenuation) is taken into account. Instead of re-computing all the lighting information, we pre-render (sample) a set of images (reference images) of the volumetric data under different illumination conditions. With these reference images, we are able to relight the volume under desired lighting condition by interpolating and superimposing pixel values. The relighting can be performed on ordinary PCs.

[1]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[2]  Marc Levoy,et al.  Efficient ray tracing of volume data , 1990, TOGS.

[3]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[4]  Hiroshi Murase,et al.  Dimensionality of Illumination Manifolds in Appearance Matching , 1996, Object Representation in Computer Vision.

[5]  Andrew Chi-Sing Leung,et al.  The plenoptic illumination function , 2002, IEEE Trans. Multim..

[6]  Julie Dorsey,et al.  Effic ient Re-rendering of Naturally Illuminated Environments , 1994 .

[7]  David S. Ebert,et al.  Designing Effective Transfer Functions for Volume Rendering from Photographic Volumes , 2002, IEEE Trans. Vis. Comput. Graph..

[8]  Jr. Leonard McMillan,et al.  An Image-Based Approach to Three-Dimensional Computer Graphics , 1997 .

[9]  Harry Shum,et al.  Relighting with the Reflected Irradiance Field: Representation, Sampling and Reconstruction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[10]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[11]  David J. Kriegman,et al.  What is the set of images of an object under all possible lighting conditions? , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Chi-Wing Fu,et al.  Interactive Relighting of Panoramas , 2001, IEEE Computer Graphics and Applications.

[13]  Gregory M. Nielson,et al.  Towards animating ray-traced volume visualization , 1990, Comput. Animat. Virtual Worlds.

[14]  Zhengyou Zhang,et al.  Modeling geometric structure and illumination variation of a scene from real images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[15]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[16]  Hanspeter Pfister,et al.  The VolumePro real-time ray-casting system , 1999, SIGGRAPH.

[17]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[18]  Gregory D. Hager,et al.  Real-time tracking of image regions with changes in geometry and illumination , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Russell A. Epstein,et al.  5/spl plusmn/2 eigenimages suffice: an empirical investigation of low-dimensional lighting models , 1995, Proceedings of the Workshop on Physics-Based Modeling in Computer Vision.

[20]  Tien-Tsin Wong,et al.  Image-based Rendering with Controllable Illumination , 1997, Rendering Techniques.