Apparent display resolution enhancement for moving images

Limited spatial resolution of current displays makes the depiction of very fine spatial details difficult. This work proposes a novel method applied to moving images that takes into account the human visual system and leads to an improved perception of such details. To this end, we display images rapidly varying over time along a given trajectory on a high refresh rate display. Due to the retinal integration time the information is fused and yields apparent super-resolution pixels on a conventional-resolution display. We discuss how to find optimal temporal pixel variations based on linear eye-movement and image content and extend our solution to arbitrary trajectories. This step involves an efficient method to predict and successfully treat potentially visible flickering. Finally, we evaluate the resolution enhancement in a perceptual study that shows that significant improvements can be achieved both for computer generated images and photographs. CR Categories: I.3.3 [Computer Graphics]: Picture/Image generation—display algorithms,viewing algorithms;

[1]  Michiel Adriaanszoon Klompenhouwer,et al.  Subpixel image scaling for color‐matrix displays , 2003 .

[2]  S P McKee,et al.  Discrimination of time: comparison of foveal and peripheral sensitivity. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[3]  Robert Ulichney,et al.  47.4: Invited Paper: Wobulation: Doubling the Addressed Resolution of Projection Displays , 2005 .

[4]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[5]  Arun N. Netravali,et al.  Reconstruction filters in computer-graphics , 1988, SIGGRAPH.

[6]  Ronald G Driggers,et al.  Target-acquisition performance in undersampled infrared imagers: static imagery to motion video. , 2005, Applied optics.

[7]  Dean S. Messing,et al.  Using optimal rendering to visually mask defective subpixels , 2006, Electronic Imaging.

[8]  Hans van Hateren A cellular and molecular model of response kinetics and adaptation in primate cones and horizontal cells. , 2005, Journal of vision.

[9]  Jeff B. Pelz,et al.  Spatio-velocity CSF as a function of retinal velocity using unstabilized stimuli , 2006, Electronic Imaging.

[10]  H DE LANGE DZN,et al.  Research into the dynamic nature of the human fovea-cortex systems with intermittent and modulated light. II. Phase shift in brithtness and delay in color perception. , 1958, Journal of the Optical Society of America.

[11]  T. Poggio,et al.  Visual hyperacuity: spatiotemporal interpolation in human vision , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[12]  J.C. Platt Optimal filtering for patterned displays , 2000, IEEE Signal Processing Letters.

[13]  오승준 [서평]「Digital Video Processing」 , 1996 .

[14]  H DE LANGE DZN,et al.  Research into the dynamic nature of the human fovea-cortex systems with intermittent and modulated light. I. Attenuation characteristics with white and colored light. , 1958, Journal of the Optical Society of America.

[15]  Michael F. Cohen,et al.  Capturing and viewing gigapixel images , 2007, ACM Trans. Graph..

[16]  A. Hendrickson,et al.  Human photoreceptor topography , 1990, The Journal of comparative neurology.

[17]  S G Lisberger,et al.  Temporal properties of visual motion signals for the initiation of smooth pursuit eye movements in monkeys. , 1994, Journal of neurophysiology.

[18]  Niranjan Damera-Venkata,et al.  Display supersampling , 2009, ACM Trans. Graph..

[19]  G. Caputo,et al.  The Glare Effect and the Perception of Luminosity , 2001, Perception.

[20]  D. Burr Acuity for apparent vernier offset , 1979, Vision Research.

[21]  Karl R Gegenfurtner,et al.  Improved visual sensitivity during smooth pursuit eye movements , 2008, Nature Neuroscience.

[22]  Klamer Schutte,et al.  Applicability of TOD, MTDP, MRT and DMRT for dynamic image enhancement techniques , 2006, SPIE Defense + Commercial Sensing.

[23]  D Purves,et al.  An Empirical Explanation of the Cornsweet Effect , 1999, The Journal of Neuroscience.

[24]  D. Hubel,et al.  The role of fixational eye movements in visual perception , 2004, Nature Reviews Neuroscience.

[25]  David Whitaker,et al.  Effects of luminance and external temporal noise on flicker sensitivity as a function of stimulus size at various eccentricities , 1994, Vision Research.

[26]  Naoki Shiramatsu,et al.  Improvement in the picture quality of moving pictures for matrix displays , 2000 .

[27]  Michael F. Deering,et al.  A photon accurate model of the human eye , 2005, SIGGRAPH '05.

[28]  Thomas F. Coleman,et al.  A Reflective Newton Method for Minimizing a Quadratic Function Subject to Bounds on Some of the Variables , 1992, SIAM J. Optim..