Calibrating, Rendering and Evaluating the Head Mounted Light Field Display

There are several benefits of using a light field display over a traditional HMD; in particular the light field can avoid the vergence-accommodation conflict and can also correct for near- and farsightedness. By rendering only four corner cameras of a subimage array, then these four views can be interpolated in order to create all subimages of the light field. We implement the interpolation of the subimages in the light field with the use of pixel reprojection, while maintaining correct perspective and shading. We give an comprehensive explanation of the construction and calibration of a head mounted light field display, and finally we evaluate the image quality through image difference and conduct a user evaluation of the light field images in order to evaluate if users are able to perceive a difference in the light field images created with the full array of virtual cameras and our method using four cameras and pixel reprojection. In most cases the users were unable to distinguish the images, and we conclude that pixel reprojection is a feasible method for rendering light fields as far as quality is concerned.

[1]  Douglas Lanman,et al.  Near-eye light field displays , 2013, SIGGRAPH Emerging Technologies.

[2]  Pitchaya Sitthi-Amorn,et al.  Automated reprojection-based pixel shader optimization , 2008, SIGGRAPH 2008.

[3]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[4]  Jason Lawrence,et al.  Accelerating real-time shading with reverse reprojection caching , 2007, GH '07.

[5]  C. Schor,et al.  Negative feedback control model of proximal convergence and accommodation , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[6]  Hans-Peter Seidel,et al.  Exploiting temporal coherence in final gathering for dynamic scenes , 2004 .

[7]  David Salesin,et al.  Spatio-angular resolution tradeoffs in integral photography , 2006, EGSR '06.

[8]  Gordon Wetzstein,et al.  The light field stereoscope , 2015, ACM Trans. Graph..

[9]  Desney S. Tan,et al.  Foveated 3D graphics , 2012, ACM Trans. Graph..

[10]  S. B. Kang.  Geometrically valid pixel reprojection methods for novel view synthesis , 1998 .

[11]  Hans-Peter Seidel,et al.  An efficient spatio-temporal architecture for animation rendering , 2003, SIGGRAPH '03.

[12]  Martin Kraus,et al.  Using a Graphics Turing Test to Evaluate the Effect of Frame Rate and Motion Blur on Telepresence of Animated Objects , 2013, GRAPP/IVAPP.

[13]  Tsuhan Chen,et al.  Light field capturing with lensless cameras , 2005, IEEE International Conference on Image Processing 2005.

[14]  Derek Nowrouzezahrai,et al.  Learning hatching for pen-and-ink illustration of surfaces , 2012, TOGS.

[15]  Martin Kraus,et al.  Quasi-Convolution Pyramidal Blurring , 2009, J. Virtual Real. Broadcast..

[16]  Hong Hua,et al.  Head-Mounted Display Systems , 2005 .

[17]  Gordon Wetzstein,et al.  Tensor displays , 2012, ACM Trans. Graph..

[18]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[19]  Larry F. Hodges,et al.  Generating exact ray-traced animation frames by reprojection , 1995, IEEE Computer Graphics and Applications.

[20]  Ricardo Martins,et al.  Compact microlenslet-array-based magnifier. , 2004, Optics letters.

[21]  S. McKee,et al.  Statistical properties of forced-choice psychometric functions: Implications of probit analysis , 1985, Perception & psychophysics.

[22]  Gregory Kramida,et al.  Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays , 2016, IEEE Transactions on Visualization and Computer Graphics.

[23]  Takashi Shibata,et al.  Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict , 2011, Electronic Imaging.

[24]  Frédo Durand,et al.  Unstructured Light Fields , 2012, Comput. Graph. Forum.

[25]  Hideshi Yamada,et al.  Rendering for an Interactive 360 ◦ Light Field Display , 2007 .

[26]  Christian Wallraven,et al.  Experimental Design: From User Studies to Psychophysics , 2011 .

[27]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[28]  Hans-Peter Seidel,et al.  On‐the‐Fly Processing of Generalized Lumigraphs , 2001, Comput. Graph. Forum.

[29]  C.-C. Jay Kuo,et al.  13.3: Efficient Direct Light‐Field Rendering for Autostereoscopic 3D Displays , 2015 .

[30]  Martin Kraus,et al.  Light Field Rendering for Head Mounted Displays using Pixel Reprojection , 2017, VISIGRAPP.

[31]  Rajaraman Suryakumar,et al.  Vergence accommodation and monocular closed loop blur accommodation have similar dynamic characteristics , 2007, Vision Research.

[32]  Mark A. Horowitz,et al.  Light field video camera , 2000, IS&T/SPIE Electronic Imaging.

[33]  Ching-Jen Chen,et al.  Numerical simulation of flow in a screw-type blood pump , 2005, J. Vis..

[34]  W. Charman.  The eye in focus: accommodation and presbyopia , 2008, Clinical & experimental optometry.