Conveying the 3D Shape of Smoothly Curving Transparent Surfaces via Texture

Transparency can be a useful device for depicting multiple overlapping surfaces in a single image. The challenge is to render the transparent surfaces in such a way that their 3D shape can be readily understood and their depth distance from underlying structures clearly perceived. This paper describes our investigations into the use of sparsely-distributed discrete, opaque texture as an artistic device for more explicitly indicating the relative depth of a transparent surface and for communicating the essential features of its 3D shape in an intuitively meaningful and minimally occluding way. The driving application for this work is the visualization of layered surfaces in radiation therapy treatment planning data, and the technique is illustrated on transparent isointensity surfaces of radiation dose. We describe the perceptual motivation and artistic inspiration for defining a stroke texture that is locally oriented in the direction of greatest normal curvature (and in which individual strokes are of a length proportional to the magnitude of the curvature in the direction they indicate), and we discuss two alternative methods for applying this texture to isointensity surfaces defined in a volume. We propose an experimental paradigm for objectively measuring observers' ability to judge the shape and depth of a layered transparent surface, in the course of a task which is relevant to the needs of radiotherapy treatment planning, and use this paradigm to evaluate the practical effectiveness of our approach through a controlled observer experiment based on images generated from actual clinical data.

[1]  P. A. Kolers Perception and representation. , 1983, Annual review of psychology.

[2]  Takafumi Saito,et al.  Real-time previewing for volume visualization , 1994, VVS '94.

[3]  Borut Zalik,et al.  Surface interrogation methods , 1995, Comput. Graph..

[4]  Dino Schweitzer,et al.  Artificial texturing: An aid to surface visualization , 1983, SIGGRAPH.

[5]  V. Ramachandran,et al.  Transparency: Relation to Depth, Subjective Contours, Luminance, and Neon Color Spreading , 1990, Perception.

[6]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[7]  W Schlegel,et al.  Display of organs and isodoses as shaded 3-D objects for 3-D therapy planning. , 1987, International journal of radiation oncology, biology, physics.

[8]  Harold L. Kundel,et al.  Perception and representation of medical images , 1993 .

[9]  Henry P. Moreton Simplified curve and surface interrogation via mathematical packages and graphics libraries and hardware , 1995, Comput. Aided Des..

[10]  Jean Ponce,et al.  Describing surfaces , 1985, Comput. Vis. Graph. Image Process..

[11]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[12]  Haim Levkowitz,et al.  Color scales for image data , 1992, IEEE Computer Graphics and Applications.

[13]  Andrew S. Glassner,et al.  An introduction to ray tracing , 1989 .

[14]  A. L. Guptill Rendering in pen and ink , 1976 .

[15]  Andrea J. van Doorn,et al.  Relief: pictorial and otherwise , 1995, Image Vis. Comput..

[16]  E Hierholzer,et al.  Analysis of human back shape using surface curvatures. , 1982, Journal of biomechanics.

[17]  David Salesin,et al.  Computer-generated pen-and-ink illustration , 1994, SIGGRAPH.

[18]  J. Todd,et al.  Perception of three-dimensional form from patterns of optical texture. , 1987, Journal of experimental psychology. Human perception and performance.

[19]  J. Aloimonos Shape from texture , 1988, Biological cybernetics.

[20]  M. Landy,et al.  A perturbation analysis of depth perception from combinations of texture and motion cues , 1993, Vision Research.

[21]  David Salesin,et al.  Interactive pen-and-ink illustration , 1994, SIGGRAPH.

[22]  J. Todd,et al.  Ordinal structure in the visual perception and cognition of smoothly curved surfaces. , 1989, Psychological review.

[23]  J. Koenderink,et al.  Photometric Invariants Related to Solid Shape , 1980 .

[24]  H. Flock,et al.  Variables of Surface Texture and Accuracy of Space Perceptions , 1964, Perceptual and motor skills.

[25]  David Salesin,et al.  Scale-dependent reproduction of pen-and-ink illustrations , 1996, SIGGRAPH.

[26]  A. Parker,et al.  Effects of different texture cues on curved surfaces viewed stereoscopically , 1993, Vision Research.

[27]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[28]  J. Gibson The perception of visual surfaces. , 1950, The American journal of psychology.

[29]  J. Cutting,et al.  Minimodularity and the perception of layout. , 1988, Journal of experimental psychology. General.

[30]  Victoria Interrante,et al.  Illustrating transparency: communicating the 3D shape of layered transparent surfaces via texture , 1996 .

[31]  A Blake,et al.  Shape from specularities: computation and psychophysics. , 1991, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[32]  Penny Rheingans,et al.  Opacity-modulating triangular textures for irregular surfaces , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[33]  P. Cavanagh,et al.  Shape from shadows. , 1989, Journal of experimental psychology. Human perception and performance.

[34]  Victoria Interrante,et al.  Enhancing transparent skin surfaces with ridge and valley lines , 1995, Proceedings Visualization '95.

[35]  H. Reeves,et al.  The Guild handbook of scientific illustration , 1991 .

[36]  J. Cutting,et al.  Three gradients and the perception of flat and curved surfaces. , 1984, Journal of experimental psychology. General.

[37]  Jakob Nielsen,et al.  Measuring usability: preference vs. performance , 1994, CACM.

[38]  Richard B. Ivry,et al.  On the role of figural organization perceptual transparency , 1988, Topical Meeting on Color Appearance.

[39]  David Salesin,et al.  Rendering parametric surfaces in pen and ink , 1996, SIGGRAPH.

[40]  M. L. Connolly Solvent-accessible surfaces of proteins and nucleic acids. , 1983, Science.

[41]  Olivier Faugeras,et al.  From partial derivatives of 3D volumic images to ridge lines , 1992, Computer Vision and Pattern Recognition.

[42]  D. Sheinberg,et al.  Shape from texture: ideal observers and human psychophysics , 1996 .

[43]  S. C. Masin,et al.  Test of Balanced Transparency , 1994, Perception.

[44]  E. Mingolla,et al.  Perception of surface curvature and direction of illumination from patterns of shading. , 1983, Journal of experimental psychology. Human perception and performance.

[45]  Arthur H. Bulbulian Medical Illustration: A Guide for the Doctor-Author and Exhibitor , 1965 .

[46]  Steven W. Zucker,et al.  Inferring Surface Trace and Differential Structure from 3-D Images , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  J T Todd,et al.  Visual perception of smoothly curved surfaces from double-projected contour patterns. , 1990, Journal of experimental psychology. Human perception and performance.

[48]  DH Hubel,et al.  Psychophysical evidence for separate channels for the perception of form, color, movement, and depth , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[49]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[50]  Andrew Blake,et al.  The information available to a moving observer from specularities , 1989, Image and Vision Computing.

[51]  Michael F. Cohen,et al.  Automatic illustration of 3D geometric models: surfaces , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[52]  Kent A. Stevens,et al.  The Visual Interpretation of Surface Contours , 1981, Artif. Intell..

[53]  Hans Hagen,et al.  Surface interrogation algorithms , 1992, IEEE Computer Graphics and Applications.

[54]  F Metelli,et al.  The perception of transparency. , 1974, Scientific American.

[55]  Marc Levoy,et al.  Volume rendering in radiation treatment planning , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[56]  Darwyn R. Peachey,et al.  Solid texturing of complex surfaces , 1985, SIGGRAPH.