Patch scanning displays: spatiotemporal enhancement for displays.

Emerging fields of mixed reality and electronic sports necessitate greater spatial and temporal resolutions in displays. We introduce a novel scanning display method that enhances spatiotemporal qualities of displays. Specifically, we demonstrate that scanning multiple image patches that are representing basis functions of each block in a target image can help to synthesize spatiotemporally enhanced visuals. To discover the right image patches, we introduce an optimization framework tailored to our hardware. In our method, spatiotemporally enhanced visuals are synthesized using an optical scanner scanning image patches from an image generator illuminated by a locally addressable backlight. As a validation of our method, we demonstrate a prototype using commodity equipment. Our method improves pixel fill factor to hundred percent and enhances spatial resolution of a display up to four times. An inherent constrain regarding to spatiotemporal qualities of displays could be solved using our method.

[1]  Jean Lorenceau,et al.  Psychophysical Assessment of Perceptual Performance With Varying Display Frame Rates , 2016, Journal of Display Technology.

[2]  Dongheon Yoo,et al.  Tomographic projector , 2019, ACM Trans. Graph..

[3]  N. Balram,et al.  An 18 megapixel 4.3″ 1443 ppi 120 Hz OLED display for wide field of view high acuity head mounted displays , 2018 .

[4]  D Whitaker,et al.  Visual acuity changes throughout adulthood in normal, healthy eyes: seeing beyond 6/6. , 1995, Optometry and vision science : official publication of the American Academy of Optometry.

[5]  Hans-Peter Seidel,et al.  Video quality assessment for computer graphics applications , 2010, SIGGRAPH 2010.

[6]  Christos Argyropoulos,et al.  Ultrafast spontaneous emission source using plasmonic nanoantennas , 2015, Nature Communications.

[7]  Hans-Peter Seidel,et al.  Apparent display resolution enhancement for moving images , 2010, SIGGRAPH 2010.

[8]  Henry Fuchs,et al.  Manufacturing Application-Driven Foveated Near-Eye Displays , 2019, IEEE Transactions on Visualization and Computer Graphics.

[9]  Edward A. Watson,et al.  A Review of Phased Array Steering for Narrow-Band Electrooptical Systems , 2009, Proceedings of the IEEE.

[10]  Meenakshisundaram Gopi,et al.  Edge-guided resolution enhancement in projectors via optical pixel sharing , 2012, ACM Trans. Graph..

[11]  Yi-Pai Huang,et al.  Resolution enhanced light field near eye display using e‐shifting method with birefringent plate , 2018 .

[12]  Henry Fuchs,et al.  An Extended Depth-at-Field Volumetric Near-Eye Augmented Reality Display , 2018, IEEE Transactions on Visualization and Computer Graphics.

[13]  Hung-Chi Lee,et al.  Humans perceive flicker artifacts at 500 Hz , 2015, Scientific Reports.

[14]  Anselmo Lastra,et al.  From Motion to Photons in 80 Microseconds: Towards Minimal Latency for Virtual and Augmented Reality , 2016, IEEE Transactions on Visualization and Computer Graphics.

[15]  Derek Nowrouzezahrai,et al.  Learning hatching for pen-and-ink illustration of surfaces , 2012, TOGS.

[16]  Byungsoo Kim,et al.  Transport-based neural style transfer for smoke simulations , 2019, ACM Trans. Graph..

[17]  Karl R Gegenfurtner,et al.  Time course of chromatic adaptation for color appearance and discrimination , 2000, Vision Research.

[18]  D. H. Kelly.  Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[19]  Shin‐Tson Wu,et al.  Improving near-eye display resolution by polarization multiplexing. , 2019, Optics express.

[20]  Piotr Didyk,et al.  Real-time Apparent Resolution Enhancement for Head-mounted Displays , 2018, PACMCGIT.

[21]  Guanjun Tan,et al.  Foveated imaging for near-eye displays. , 2018, Optics express.

[22]  Hans-Peter Seidel,et al.  Animating deformable objects using sparse spacetime constraints , 2014, ACM Trans. Graph..

[23]  A. Wilkins,et al.  Flicker can be perceived during saccades at frequencies in excess of 1 kHz , 2013 .