Resolution enhancement by vibrating displays

We present a method that makes use of the retinal integration time in the human visual system for increasing the resolution of displays. Given an input image with a resolution higher than the display resolution, we compute several images that match the display's native resolution. We then render these low-resolution images in a sequence that repeats itself on a high refresh-rate display. The period of the sequence falls below the retinal integration time and therefore the eye integrates the images temporally and perceives them as one image. In order to achieve resolution enhancement we apply small-amplitude vibrations to the display panel and synchronize them with the screen refresh cycles. We derive the perceived image model and use it to compute the low-resolution images that are optimized to enhance the apparent resolution of the perceived image. This approach achieves resolution enhancement without having to move the displayed content across the screen and hence offers a more practical solution than existing approaches. Moreover, we use our model to establish limitations on the amount of resolution enhancement achievable by such display systems. In this analysis we draw a formal connection between our display and super-resolution techniques and find that both methods share the same limitation, yet this limitation stems from different sources. Finally, we describe in detail a simple physical realization of our display system and demonstrate its ability to match most of the spectrum displayable on a screen with twice the resolution.

[1]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[2]  Heung-Yeung Shum,et al.  Fundamental limits of reconstruction-based superresolution algorithms under local translation , 2004 .

[3]  Harry Shum,et al.  On the fundamental limits of reconstruction-based super-resolution algorithms , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  David Whitaker,et al.  Effects of luminance and external temporal noise on flicker sensitivity as a function of stimulus size at various eccentricities , 1994, Vision Research.

[5]  Hans-Peter Seidel,et al.  Apparent display resolution enhancement for moving images , 2010, ACM Trans. Graph..

[6]  Shree K. Nayar,et al.  Jitter camera: high resolution video from a low resolution detector , 2004, CVPR 2004.

[7]  Niranjan Damera-Venkata,et al.  Display supersampling , 2009, ACM Trans. Graph..

[8]  Kenneth H. Norwich,et al.  Information, sensation, and perception , 1993 .

[9]  J.C. Platt Optimal filtering for patterned displays , 2000, IEEE Signal Processing Letters.

[10]  Russell C. Hardie,et al.  A Fast Image Super-Resolution Algorithm Using an Adaptive Wiener Filter , 2007, IEEE Transactions on Image Processing.

[11]  Dante C. Youla,et al.  Generalized Image Restoration by the Method of Alternating Orthogonal Projections , 1978 .

[12]  Hans-Peter Seidel,et al.  Perceptually‐motivated Real‐time Temporal Upsampling of 3D Content for High‐refresh‐rate Displays , 2010, Comput. Graph. Forum.

[13]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[14]  Niranjan Damera-Venkata,et al.  Realizing Super-Resolution with Superimposed Projection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Robert Ulichney,et al.  47.4: Invited Paper: Wobulation: Doubling the Addressed Resolution of Projection Displays , 2005 .

[16]  Hans-Peter Seidel,et al.  Apparent resolution enhancement for animations , 2011, SCC.

[17]  Oliver Cossairt,et al.  Imaging artifact precompensation for spatially multiplexed 3-D displays , 2008, Electronic Imaging.

[18]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[19]  S P McKee,et al.  Discrimination of time: comparison of foveal and peripheral sensitivity. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[20]  Aharon J. Agranat,et al.  Refractive index engineering by fast ion implantations: a generic method for constructing multi-components electro-optical circuits , 2010, OPTO.

[21]  Michal Irani,et al.  Super resolution from image sequences , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[22]  Christopher Jaynes,et al.  Super-Resolution Composition in Multi-Projector Displays , 2003 .

[23]  Niranjan Damera-Venkata,et al.  On the Resolution Limits of Superimposed Projection , 2007, 2007 IEEE International Conference on Image Processing.

[24]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[25]  Takeo Kanade,et al.  Limits on super-resolution and how to break them , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).