RAYS (Render As You See): Vision-Realistic Rendering Using Hartmann-Shack Wavefront Aberrations

RAYS (RenderAsYouSee) is a system for “vision-realistic rendering” which can simulate the vision of actual patients. Patie nt data is derived from sensors, called Hartmann-Shack devices, th at capture the wavefront aberrations present in the patient’s ent ire optical pathway of a single point source of light in the retina. The input to RAYS is an image, corresponding depth information, and a wavefront derived from the Hartmann-Shack devic e. Given a focusing distance, our vision-realistic rendering algorithm then blurs the scene appropriately. The result is an image th at closely approximates what the actual patient would have see n if focused at that distance. Vision-realistic rendering is particularly interesting i n the context of laser refractive eye surgeries such as PRK and LASIK. Currently, almost a million Americans per year are choosing to u ndergo such elective surgeries. RAYS could convey to doctors the vi sion of a patient before and after surgery. In addition, RAYS could p rovide accurate and revealing visualizations of predicted acuity and simulated vision to potential candidates for such surgeries to facilitate educated decisions about the procedure. Still another appl ic tion would be to show such candidates the possible visual anomali es that could arise from the surgery (such as glare at night). CR Categories: I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism—Color, shading, shadowing, and textu r ; I.3.3 [Computer Graphics]: Picture/Image Generation—Dis play algorithms, Viewing algorithms;

[1]  G. Westheimer,et al.  Light distribution in the image formed by the living human eye. , 1962, Journal of the Optical Society of America.

[2]  Gary W. Meyer,et al.  A perceptually based adaptive sampling algorithm , 1998, SIGGRAPH.

[3]  Donald P. Greenberg,et al.  A multiscale model of adaptation and spatial vision for realistic image display , 1998, SIGGRAPH.

[4]  Jon J. Camp,et al.  An efficient ray tracing algorithm for modeling visual performance from corneal topography , 1990, [1990] Proceedings of the First Conference on Visualization in Biomedical Computing.

[5]  Leon Lagnado,et al.  The retina , 1999, Current Biology.

[6]  E LeeMark,et al.  Statistically optimized sampling for distributed ray tracing , 1985 .

[7]  R A Robb,et al.  A computer model for the evaluation of the effect of corneal topography on optical performance. , 1990, American journal of ophthalmology.

[8]  J. Roufs,et al.  Point spread functions and detail detection. , 1987, Spatial vision.

[9]  D. Spencer,et al.  On the Stiles-Crawford effect , 1944 .

[10]  D. Atchison,et al.  The eye and visual optical instruments: Frontmatter , 1997 .

[11]  Brian A. Barsky,et al.  CWhatUC: a visual acuity simulator , 1998, Photonics West - Biomedical Optics.

[12]  Robert L. Cook,et al.  Stochastic sampling in computer graphics , 1988, TOGS.

[13]  Robert L. Cook,et al.  Distributed ray tracing , 1998 .

[14]  A. Tomlinson,et al.  Corneal optics from videokeratographs. , 1995, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[15]  J M Miller,et al.  Visual acuity modeling using optical raytracing of schematic eyes. , 1995, American journal of ophthalmology.

[16]  Brian A. Barsky,et al.  Cwhatuc: software tools for predicting, visualizing and simulating corneal visual acuity , 2000 .

[17]  D. O'shea,et al.  Elements of Modern Optical Design , 1985 .

[18]  Mark A. Z. Dippé,et al.  Antialiasing through stochastic sampling , 1985, SIGGRAPH.

[19]  S A Klein,et al.  Optimal corneal ablation for eyes with arbitrary Hartmann-Shack aberrations. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Pat Hanrahan,et al.  A realistic camera model for computer graphics , 1995, SIGGRAPH.

[21]  Steven Dale Upstill The realistic presentation of synthetic images: image processing in computer graphics , 1985 .

[22]  T. Seiler,et al.  Effective spherical aberration of the cornea as a quantitative descriptor in corneal topography , 1993, Journal of cataract and refractive surgery.

[23]  L N Thibos,et al.  Principles of Hartmann-Shack aberrometry. , 2000, Journal of refractive surgery.

[24]  H. Spekreijse,et al.  An improved mathematical description of the foveal visual point spread function with parameters for age, pupil size and pigmentation , 1993, Vision Research.

[25]  P. L. Knight,et al.  Optics (Second Edition) , 1989 .

[26]  L J Maguire,et al.  Topography and raytracing analysis of patients with excellent visual acuity 3 months after excimer laser photorefractive keratectomy for myopia. , 1991, Refractive & corneal surgery.

[27]  Richard A. Robb,et al.  Informing interested parties of changes in the optical performance of the cornea caused by keratorefractive surgery: a ray-tracing model that tailors presentation of results to fit the level of soph , 1992, Other Conferences.

[28]  P Artal,et al.  Retrieval of wave aberration of human eyes from actual point-spread-function data. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[29]  Donald J. Lyle,et al.  The Retinal Ganglion Cell Layer , 1964 .

[30]  Donald P. Greenberg,et al.  Physically-based glare effects for digital images , 1995, SIGGRAPH.

[31]  W. T. Welford,et al.  Aberrations of optical systems , 1986 .

[32]  Alexander C. Berg,et al.  Incorporating camera models, ocular models, and actual patient eye data for photo-realistic and vision-realistic rendering , 2000 .

[33]  Michael Potmesil,et al.  A lens and aperture camera model for synthetic image generation , 1981, SIGGRAPH '81.