Photorealistic modeling of tissue reflectance properties

Objective: For Minimally Invasive Surgery (MIS) procedures, specular highlights constitute important visual cues for gauging tissue deformation as well as perceiving depth and orientation. This paper describes a novel reflectance modeling technique that is particularly suitable for simulating light interaction behavior with mucus-covered tissue surfaces. Methods: The complex and largely random tissue-light interaction behavior is modeled with a noise-based approach. In the proposed technique, Perlin noise is used to modulate the shape of specular highlights and imitate the effects of the complex tissue structure on reflected lighting. For efficient execution, the noise texture is generated in pre-processing and stored in an image-based representation, i.e., a reflectance map. At run-time, the graphics hardware is used to attain per-pixel control and achieve realistic tissue appearance. Results: The reflectance modeling technique has been used to replicate light-tissue reflection in surgical simulation. By comparing the results acquired against those obtained from conventional per-vertex Phong lighting and OpenGL multi-texturing, it is observed that the noise-based approach achieves improved tissue appearance similar to that observed in real procedures. Detailed user evaluation demonstrates the quality and practical value of the technique for increased perception of photorealism. Conclusion: The proposed technique presents a practical strategy for surface reflectance modeling that is suitable for real-time interactive surgical simulation. The use of graphics hardware further enhances the practical value of the technique.

[1]  Alan Liu,et al.  A Survey of Surgical Simulation: Applications, Technology, and Education , 2003, Presence: Teleoperators & Virtual Environments.

[2]  Ara Darzi,et al.  Simulation and skills assessment , 2001, Proceedings International Workshop on Medical Imaging and Augmented Reality.

[3]  Marc Olano,et al.  Interactive multi-pass programmable shading , 2000, SIGGRAPH.

[4]  Pat Hanrahan,et al.  Reflection from layered surfaces due to subsurface scattering , 1993, SIGGRAPH.

[5]  Donald P. Greenberg,et al.  A comprehensive physical model for light reflection , 1991, SIGGRAPH.

[6]  M. Bro-nielsen,et al.  Simulation techniques for minimally invasive surgery , 1997 .

[7]  William B. Langdon.  The Cg Tutorial, Fernando and Kilgard, Addison-Wesley nVidia ISBN 0-321-19496-9 , 2007 .

[8]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[9]  Peter Shirley,et al.  A practitioners' assessment of light reflection models , 1997, Proceedings The Fifth Pacific Conference on Computer Graphics and Applications.

[10]  Gregory J. Ward,et al.  Measuring and modeling anisotropic reflection , 1992, SIGGRAPH.

[11]  William R. Mark,et al.  Cg: a system for programming graphics hardware in a C-like language , 2003, ACM Trans. Graph..

[12]  Bui Tuong Phong.  Illumination for computer generated pictures , 1975, Commun. ACM.

[13]  Naga K. Govindaraju,et al.  A Survey of General‐Purpose Computation on Graphics Hardware , 2007 .

[14]  Guang-Zhong Yang,et al.  Enhancement of Visual Realism with BRDF for Patient Specific Bronchoscopy Simulation , 2004, MICCAI.

[15]  Wojciech Matusik,et al.  A data-driven reflectance model , 2003, ACM Trans. Graph..

[16]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[17]  David S. Ebert,et al.  Texturing and Modeling: A Procedural Approach , 1994 .

[18]  Jason Weber,et al.  Creation and rendering of realistic trees , 1995, SIGGRAPH.

[19]  Ken Perlin,et al.  An image synthesizer , 1988 .

[20]  James F. Blinn,et al.  Light reflection functions for simulation of clouds and dusty surfaces , 1982, SIGGRAPH.

[21]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[22]  Guang-Zhong Yang,et al.  Patient-specific bronchoscope simulation with pq-space-based 2D/3D registration , 2004, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.