Visual chatter in the real world

When a scene is lit by a source of light, the radiance of each point in the scene can be viewed as having two components, namely, direct and global. Recently, an efFIcient separation method has been proposed that uses high frequency illumination patterns to measure the direct and global components of a scene. The global component could arise from not only interreflections but also subsurface scattering within translucent surfaces and volumetric scattering by participating media. In this paper, we use this method to measure the direct and global components of a variety of natural and man-made materials. The computed direct and global images provide interesting insights into the scattering properties of common real-world materials. We have also measured the two components for a 3D texture as a function of lighting direction. This experiment shows that the global component of a BTF tends vary smoothly with respect to the lighting direction compared to the direct component of the BTF. Finally, we apply the separation method to a translucent object for different imaging and illumination scales (resolutions). The results obtained show how the BSSDRF of the object gradually reduces to a BRDF as one goes from fine to coarse scale. All the measurement results reported here, as well as several others, can be viewed as high resolution images at http://www1.cs.columbia.edu/CAVE/projects/separation/separation.php.

[1]  Ramesh Raskar,et al.  Fast separation of direct and global components of a scene using high frequency illumination , 2006, ACM Trans. Graph..

[2]  Kiriakos N. Kutulakos,et al.  A theory of inverse light transport , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[3]  Steve Marschner,et al.  Dual photography , 2005, ACM Trans. Graph..

[4]  S. Nayar,et al.  A practical analytic single scattering model for real time rendering , 2005, ACM Trans. Graph..

[5]  Stephen H. Westin,et al.  Measuring and modeling the appearance of finished wood , 2005, ACM Trans. Graph..

[6]  Tim Weyrich,et al.  A Measurement-Based Skin Reflectance Model for Face Rendering and Editing , 2005 .

[7]  S. Nayar,et al.  The Appearance of Human Skin , 2005 .

[8]  Kristin J. Dana,et al.  Bidirectional imaging and modeling of skin texture , 2004, IEEE Transactions on Biomedical Engineering.

[9]  Yee-Hong Yang,et al.  Frequency-based environment matting , 2004, 12th Pacific Conference on Computer Graphics and Applications, 2004. PG 2004. Proceedings..

[10]  H. Seidel,et al.  DISCO: acquisition of translucent objects , 2004, ACM Trans. Graph..

[11]  Mark S. Drew,et al.  Color constancy from mutual reflection , 1991, International Journal of Computer Vision.

[12]  Jan J. Koenderink,et al.  The secret of velvety skin , 2003, Machine Vision and Applications.

[13]  Norimichi Tsumura,et al.  Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin , 2003, ACM Trans. Graph..

[14]  Steve Marschner,et al.  Light scattering from human hair fibers , 2003, ACM Trans. Graph..

[15]  Pieter Peers,et al.  Wavelet Environment matting , 2003, Rendering Techniques.

[16]  Harry Shum,et al.  Relighting with the Reflected Irradiance Field: Representation, Sampling and Reconstruction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Steve Marschner,et al.  A practical model for subsurface light transport , 2001, SIGGRAPH.

[18]  H. Jensen Realistic Image Synthesis Using Photon Mapping , 2001 .

[19]  Irfan A. Essa,et al.  Real-time Photo-Realistic Physically Based Rendering of Fine Scale Human Skin Structure , 2001, Rendering Techniques.

[20]  Paul E. Debevec,et al.  Acquiring the reflectance field of a human face , 2000, SIGGRAPH.

[21]  Jan J. Koenderink,et al.  Specularities on surfaces with tangential hairs or grooves , 2000, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  A. Hurlbert,et al.  Perception of three-dimensional shape influences colour perception through mutual illumination , 1999, Nature.

[23]  David Salesin,et al.  Environment matting and compositing , 1999, SIGGRAPH.

[24]  Akira Ishimaru,et al.  Wave propagation and scattering in random media , 1997 .

[25]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Takashi Komeda,et al.  Quantification of skin aging by three-dimensional measurement of skin surface contour , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).

[27]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[28]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[29]  Constantin V. Prikhodko,et al.  Optical properties of human hair , 1995, Other Conferences.

[30]  Pat Hanrahan,et al.  Reflection from layered surfaces due to subsurface scattering , 1993, SIGGRAPH.

[31]  R. Smith,et al.  Investigation into the scattering of light by human hair. , 1991, Applied optics.

[32]  David A. Forsyth,et al.  Reflections on Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Takeo Kanade,et al.  Shape from interreflections , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[34]  Donald P. Greenberg,et al.  A radiosity method for non-diffuse environments , 1986, SIGGRAPH.

[35]  James T. Kajiya,et al.  The rendering equation , 1986, SIGGRAPH.

[36]  W. K. Purves Life: The Science of Biology , 1985 .

[37]  J. Koenderink,et al.  Geometrical modes as a general method to treat diffuse interreflections in radiometry , 1983 .

[38]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[39]  A. Gilchrist The perception of surface blacks and whites. , 1979, Scientific American.

[40]  A. Cantor Optics of the atmosphere--Scattering by molecules and particles , 1978, IEEE Journal of Quantum Electronics.

[41]  R. Stamm,et al.  The optical properties of human hair I. Fundamental considerations and goniophotometer curves , 1977 .

[42]  E. J. Mccartney,et al.  Optics of the Atmosphere: Scattering by Molecules and Particles , 1977 .

[43]  F. E. Nicodemus Reflectance nomenclature and directional reflectance and emissivity. , 1970, Applied optics.

[44]  W. Middleton,et al.  Vision Through the Atmosphere , 1952 .