Optimal allocation of quantized human eye depth perception for multi-focal 3D display design.

Creating immersive 3D stereoscopic, autostereoscopic, and lightfield experiences are becoming the center point of optical design of future head mounted displays and lightfield displays. However, despite the advancement in 3D and light field displays, there is no consensus on what are the necessary quantized depth levels for such emerging displays at stereoscopic or monocular modalities. Here we start from psychophysical theories and work toward defining and prioritizing quantized levels of depth that would saturate the human depth perception. We propose a general optimization framework, which locates the depth levels in a globally optimal way for band limited displays. While the original problem is computationally intractable, we manage to find a tractable reformulation as maximally covering a region of interest with a selection of hypographs corresponding to the monocular depth of field profiles. The results indicate that on average 1731 stereoscopic and 7 monocular depth levels (distributed optimally from 25 cm to infinity) would saturate the visual depth perception. Such that adding further depth levels adds negligible improvement. Also the first 3 depth levels should be allocated at (148), then (83, 170), then (53, 90, 170) distances respectively from the face plane to minimize the monocular error in the entire population. The study further discusses the 3D spatial profile of the quantized stereoscopic and monocular depth levels. The study provides fundamental guidelines for designing optimal near eye displays, light-field monitors, and 3D screens.

[1]  J. Romberg,et al.  Terahertz time-gated spectral imaging for content extraction through layered structures , 2016, Nature Communications.

[2]  Andrea Canessa,et al.  The Active Side of Stereopsis: Fixation Strategy and Adaptation to Natural Environments , 2017, Scientific Reports.

[3]  Hung-Chi Lee,et al.  Humans perceive flicker artifacts at 500 Hz , 2015, Scientific Reports.

[4]  Nobuyuki Fujisawa,et al.  Occurrence of asymmetrical flow pattern behind an orifice in a circular pipe , 2011, J. Vis..

[5]  Justin K. Romberg,et al.  Sparse Shape Reconstruction , 2013, SIAM J. Imaging Sci..

[6]  Hong Hua,et al.  Systematic characterization and optimization of 3D light field displays. , 2017, Optics express.

[7]  Dongheon Yoo,et al.  Tomographic projector , 2019, ACM Trans. Graph..

[8]  Pawan Sinha,et al.  Top-down influences on stereoscopic depth-perception , 1998, Nature Neuroscience.

[9]  Tom E. Bishop,et al.  The Light Field Camera: Extended Depth of Field, Aliasing, and Superresolution , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  R Navarro,et al.  Monochromatic aberrations and point-spread functions of the human eye across the visual field. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  Marco Fiorentino,et al.  A multi-directional backlight for a wide-angle, glasses-free three-dimensional display , 2013, Nature.

[12]  F. W. Campbell,et al.  Effect of Focus on the Visual Response to a Sinusoidally Modulated Spatial Stimulus , 1965 .

[13]  Julie M. Harris,et al.  Stereoscopic perception of real depths at large distances. , 2010, Journal of vision.

[14]  Kenneth N. Ogle,et al.  Stereoscopic Acuity and the Role of Convergence , 1956 .

[15]  Daniele Panozzo,et al.  Position-based tensegrity design , 2017, ACM Trans. Graph..

[16]  Ching-Jen Chen,et al.  Numerical simulation of flow in a screw-type blood pump , 2005, J. Vis..

[17]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[18]  Jacqueline M. Fulvio,et al.  Use of cues in virtual reality depends on visual feedback , 2017, Scientific Reports.

[19]  P. Blanche,et al.  An updatable holographic three-dimensional display , 2008, Nature.

[20]  Agostino Gibaldi,et al.  Binocular Eye Movements Are Adapted to the Natural Environment , 2019, The Journal of Neuroscience.

[21]  Yasuhiro Takaki,et al.  Multi-projection of lenticular displays to construct a 256-view super multi-view display. , 2010, Optics express.

[22]  W. Larson,et al.  Stereoscopic Acuity with Induced Refractive Errors , 1983, American Journal of Optometry and Physiological Optics.

[23]  K. Palczewski,et al.  Advances in understanding the molecular basis of the first steps in color vision , 2015, Progress in Retinal and Eye Research.

[24]  F. Campbell,et al.  A method for measuring the depth of field of the human eye. , 1957, The Journal of physiology.

[25]  L. Onural,et al.  State of the Art in Holographic Displays: A Survey , 2010, Journal of Display Technology.

[26]  Toshiaki Fujii,et al.  From Focal Stack to Tensor Light-Field Display , 2018, IEEE Transactions on Image Processing.

[27]  Norberto López-Gil,et al.  Depth-of-Field of the Accommodating Eye , 2014, Optometry and vision science : official publication of the American Academy of Optometry.

[28]  G E Legge,et al.  Tolerance to visual defocus. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[29]  Kenneth N. Ogle,et al.  An Analytical Treatment of the Longitudinal Horopter; Its Measurement and Application to Related Phenomena, Especially to the Relative Size and Shape of the Ocular Images* , 1932 .

[30]  A. Lit,et al.  Depth-discrimination thresholds as a function of binocular differences of retinal illuminance at scotopic and photopic levels. , 1959, Journal of the Optical Society of America.

[31]  Nobuyuki Hiruma,et al.  Higher resolution stimulus facilitates depth perception: MT+ plays a significant role in monocular depth perception , 2014, Scientific Reports.

[32]  R. Manny,et al.  Minus-lens-stimulated accommodative amplitude decreases sigmoidally with age: a study of objectively measured accommodative amplitudes from age 3. , 2008, Investigative ophthalmology & visual science.

[33]  Yasuhiro Takaki,et al.  High-Density Directional Display for Generating Natural Three-Dimensional Images , 2006, Proceedings of the IEEE.

[34]  Alexei A. Goon,et al.  Multifocal planes head-mounted displays. , 2000, Applied optics.

[35]  Justin K. Romberg,et al.  Convex Cardinal Shape Composition , 2015, SIAM J. Imaging Sci..

[36]  Jie-Mei Wang,et al.  Statistical virtual eye model based on wavefront aberration. , 2012, International journal of ophthalmology.

[37]  Sheng Liu,et al.  A systematic method for designing depth-fused multi-focal plane three-dimensional displays. , 2010, Optics express.

[38]  Pablo Artal,et al.  The wide-angle point spread function of the human eye reconstructed by a new optical method. , 2012, Journal of vision.

[39]  Douglas Lanman,et al.  Focal surface displays , 2017, ACM Trans. Graph..

[40]  A. Watson A formula for human retinal ganglion cell receptive field density as a function of visual field location. , 2014, Journal of vision.

[41]  Kevin J. MacKenzie,et al.  Accommodation to multiple-focal-plane displays: Implications for improving stereoscopic displays and for accommodation control. , 2010, Journal of vision.

[42]  Zhiyong Pang,et al.  Improved spatiotemporal-multiplexing super-multiview display based on planar aligned OLED microdisplays. , 2015, Optics express.

[43]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[44]  G Westheimer,et al.  Contrast and duration of exposure differentially affect vernier and stereoscopic acuity , 1990, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[45]  Kenneth N. Ogle,et al.  Corresponding Retinal Points, the Horopter and Size and Shape of Ocular Images* , 1932 .

[46]  A. Parker Binocular depth perception and the cerebral cortex , 2007, Nature Reviews Neuroscience.

[47]  Quan Huynh-Thu,et al.  Effect of the accommodation-vergence conflict on vergence eye movements , 2014, Vision Research.

[48]  Robert Patterson,et al.  Human factors of 3‐D displays , 2007 .

[49]  Sui H Wong,et al.  How to interpret visual fields , 2015, Practical Neurology.

[50]  A Yonas,et al.  A comparison of monocular and binocular depth perception in 5- and 7-month-old infants. , 1984, Journal of experimental child psychology.

[51]  Luis Alberto Carvalho Accuracy of Zernike polynomials in characterizing optical aberrations and the corneal surface of the eye. , 2005, Investigative ophthalmology & visual science.

[52]  Susana Marcos,et al.  The depth-of-field of the human eye from objective and subjective measurements , 1999, Vision Research.

[53]  L Alberto V Carvalho,et al.  Measuring higher order optical aberrations of the human eye: techniques and applications. , 2002, Brazilian journal of medical and biological research = Revista brasileira de pesquisas medicas e biologicas.

[54]  Justin Romberg,et al.  Extracting the Principal Shape Components via Convex Programming , 2018, IEEE Transactions on Image Processing.

[55]  D. H. Kelly Spatio-temporal frequency characteristics of color-vision mechanisms* , 1974 .