A Framework for Aberration Compensated Displays

We are building upon our earlier work in Vision-Realistic Rendering, which is the computation of a displayed image that incorporates the characteristics of a particular individual’s entire optical system. The key concept is, given the optical measurements of an individual’s optical system, perform an “inverse blurring” computation on what would normally be displayed such that when this blurred version of the display is then viewed by this individual, it will appear in sharp focus when viewed by the individual whose optical system was used for this inverse blurring computation. There are two major impediments to performing inverse blurring: the generated image will have large, and even negative, values for some intensities, and some frequencies are lost after blurring. Building a high dynamic range display system will overcome the large/negative intensities problems. Introducing multiple layers of display with each layer located at a different viewing distance will overcome the lost frequencies. Next, there is the question of occlusion due to the multiple layers. One solution would be to use transparent displays, but if they cannot support high dynamic range imaging then an alternative is to construct a light-path-modulating system using mirrors to change the path of lights. The potential benefits are enormous for people who require vision correction, especially those whose optical problems include high-order aberrations since these aberrations are not corrected by eyeglasses. One application would involve construction of an “Aberration Compensated Display” in which the display would show images that have been transformed by inverse blurring individualized to the viewer such that when viewed by his or her optical system the resulting image will appear sharp. This will be useful for displays for computer monitors and hand-held mobile devices such as tablets and mobile phones.

[1]  Robert Ulichney,et al.  47.4: Invited Paper: Wobulation: Doubling the Addressed Resolution of Projection Displays , 2005 .

[2]  Jian Sun,et al.  Progressive inter-scale and intra-scale non-blind image deconvolution , 2008, SIGGRAPH 2008.

[3]  Armando Barreto,et al.  Digital image inverse filtering for improving visual acuity for computer users with visual aberrations , 2008 .

[4]  L. Lucy An iterative technique for the rectification of observed distributions , 1974 .

[5]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[6]  Armando Barreto,et al.  Pre-compensation for high-order aberrations of the human eye using on-screen image deconvolution , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[7]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH 2006.

[8]  Hideshi Yamada,et al.  Rendering for an interactive 360° light field display , 2007, ACM Trans. Graph..

[9]  Hideo Saito,et al.  Focal Pre-Correction of Projected Image for Deblurring Screen Image , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Ming Ouhyoung,et al.  An esthetics rule-based ranking system for amateur photos , 2009, SIGGRAPH ASIA '09.

[11]  Frédo Durand,et al.  Understanding and evaluating blind deconvolution algorithms , 2009, CVPR.

[12]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  M. Alonso,et al.  Improving computer interaction for users with visual acuity deficiencies through inverse point spread function processing , 2005, Proceedings. IEEE SoutheastCon, 2005..

[14]  William T. Freeman,et al.  Removing camera shake from a single photograph , 2006, SIGGRAPH 2006.

[15]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[16]  Frédo Durand,et al.  Image and depth from a conventional camera with a coded aperture , 2007, SIGGRAPH 2007.

[17]  Amit K. Agrawal,et al.  Invertible motion blur in video , 2009, SIGGRAPH 2009.

[18]  Wolfgang Heidrich,et al.  High dynamic range display systems , 2004, SIGGRAPH 2004.

[19]  Brian A. Barsky Vision-realistic rendering: simulation of the scanned foveal image from wavefront data of human subjects , 2004, APGV '04.

[20]  Hui Ma,et al.  Image Deblurring with Blurred / Noisy Image Pairs , 2013 .

[21]  The prevalence and risk factors for refractive errors in an adult Chinese population in Singapore. , 2000 .

[22]  Gordon Wetzstein,et al.  Coded aperture projection , 2008, SIGGRAPH '08.

[23]  Ming Ouhyoung,et al.  Personalized photograph ranking and selection system , 2010, ACM Multimedia.

[24]  Niranjan Damera-Venkata,et al.  Display supersampling , 2009, ACM Trans. Graph..

[25]  Gordon Wetzstein,et al.  Layered 3D: tomographic image synthesis for attenuation-based light field and high dynamic range displays , 2011, SIGGRAPH 2011.

[26]  Armando Barreto,et al.  HOWARD: High-Order Wavefront Aberration Regularized Deconvolution for Enhancing Graphic Displays for Visually Impaired Computer Users , 2006, ICCHP.

[27]  James Gao,et al.  High-speed switchable lens enables the development of a volumetric stereoscopic display. , 2009, Optics express.

[28]  M. Alonso An Image Processing Approach to Pre-compensation for Higher-Order Aberrations in the Eye , 2003 .

[29]  Shree K. Nayar,et al.  Transactions on Pattern Analysis and Machine Intelligence Flexible Depth of Field Photography 1 Depth of Field , 2022 .

[30]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[31]  Michael S. Brown,et al.  Image Pre-Conditioning for Out-of-Focus Projector Blur , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[32]  M. Mochizuki,et al.  The quality of life in patients with pathologic myopia. , 2001, Japanese journal of ophthalmology.

[33]  John I. Yellott,et al.  Correcting spurious resolution in defocused images , 2007, Electronic Imaging.

[34]  Hans-Peter Seidel,et al.  Apparent display resolution enhancement for moving images , 2010, ACM Trans. Graph..

[35]  Oliver Bimber,et al.  Superimposing dynamic range , 2008, SIGGRAPH Asia '08.