Perceivable Light Fields: Matching the Requirements Between the Human Visual System and Autostereoscopic 3-D Displays

Recently, there has been a substantial increase in efforts to develop 3-D visualization technologies that can provide the viewers with a realistic 3-D visual experience. Various terms such as “reality communication” have been used to categorize these efforts. In order to provide the viewers with a complete and realistic visual sensation, the display or visualization system and the displayed content need to match the physiological 3-D information sensing capabilities of the human visual system which can be quite complex. These may include spatial and temporal resolutions, depth perception, dynamic range, spectral contents, nonlinear effects, and vergence accommodation effects. In this paper, first we present an overview of some of the 3-D display research efforts which have been extensively pursued in Asia, Europe, and North America among other areas. Based on the limitations and comfort-based requirements of the human visual system when viewing a nonnatural visual input from 3-D displays, we present an analytical framework that combines main perception and human visual requirements with analytical tools and principles used in related disciplines such as optics, computer graphics, computational imaging, and signal processing. Building on the widely used notion of light fields, we define a notion of perceivable light fields to account for the human visual system physiological requirements, and propagate it back to the display device to determine the display device specifications. This helps us clarify the fundamental and practical requirements of the 3-D display devices for reality viewing communication. In view of the proposed analytical framework, we overview various methods that can be applied to overcome the extensive information needed to be displayed in order to meet the requirements imposed by the human visual system.

[1]  Du-Sik Park,et al.  Optimal projector configuration design for 300-Mpixel multi-projection 3D display. , 2013, Optics express.

[2]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[3]  Makoto Okui,et al.  Integral Three-Dimensional Television Using a 33-Megapixel Imaging System , 2010, Journal of Display Technology.

[4]  Lei Li,et al.  Depth Calculation Method of Integral Imaging Based on Gaussian Beam Distribution Model , 2012, Journal of Display Technology.

[5]  Miguel A. Alonso,et al.  Wigner functions in optics: describing beams as ray bundles and pulses as particle ensembles , 2011 .

[6]  H Ohzu,et al.  Accommodative responses to stereoscopic three-dimensional display. , 1997, Applied optics.

[7]  Bahram Javidi,et al.  Analysis of the depth of field of integral imaging displays based on wave optics. , 2013, Optics express.

[8]  Bahram Javidi,et al.  Three-dimensional recognition of occluded objects by using computational integral imaging. , 2006, Optics letters.

[9]  F. Okano,et al.  Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television , 2005, Journal of Display Technology.

[10]  B. Javidi,et al.  Effects of device resolution on three-dimensional integral imaging. , 2004, Optics letters.

[11]  Sehoon Yea,et al.  Resampling, Antialiasing, and Compression in Multiview 3-D Displays , 2007, IEEE Signal Processing Magazine.

[12]  M. Levoy,et al.  Wigner distributions and how they relate to the light field , 2009, 2009 IEEE International Conference on Computational Photography (ICCP).

[13]  Bahram Javidi,et al.  Progress in 3-D Multiperspective Display by Integral Imaging , 2009, Proceedings of the IEEE.

[14]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[15]  Masaki Emoto,et al.  Two factors in visual fatigue caused by stereoscopic HDTV images , 2004 .

[16]  Masahiro Yamaguchi,et al.  Calculation for computer generated hologram using ray-sampling plane. , 2011, Optics express.

[17]  Alonso Measurement of Helmholtz wave fields , 2000, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  John A. Clarke,et al.  Characterization and optimization of 3D-LCD module design , 1997, Electronic Imaging.

[19]  Bahram Javidi,et al.  Three-Dimensional Television, Video and Display Technology , 2002 .

[20]  Nicolas S. Holliman,et al.  Observer-tracking autostereoscopic 3D display systems , 1997, Electronic Imaging.

[21]  B. Javidi,et al.  Spatiotemporally multiplexed integral imaging projector for large-scale high-resolution three-dimensional display. , 2004, Optics express.

[22]  Joohwan Kim,et al.  Three-dimensional electro-floating display system using an integral imaging method. , 2005, Optics express.

[23]  S. A. Collins Lens-System Diffraction Integral Written in Terms of Matrix Optics , 1970 .

[24]  Peter A Howarth,et al.  Potential hazards of viewing 3‐D stereoscopic television, cinema and computer games: a review , 2011, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[25]  Soo-Chang Pei,et al.  Eigenfunctions of the offset Fourier, fractional Fourier, and linear canonical transforms. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  Bin Wang,et al.  Depth-of-focus of the human eye: theory and clinical implications. , 2006, Survey of ophthalmology.

[27]  A. Stern,et al.  Ray phase space approach for 3-D imaging and 3-D optical data representation , 2005, Journal of Display Technology.

[28]  C. Wheatstone XVIII. Contributions to the physiology of vision. —Part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision , 1962, Philosophical Transactions of the Royal Society of London.

[29]  Dennis R. Proffitt,et al.  Depth Perception and the Perception of Events , 2003 .

[30]  Jung-Young Son,et al.  Image Light Distribution in the Multiview 3-D Imaging System , 2010, Journal of Display Technology.

[31]  Toshio Honda,et al.  Hologramlike video images by 45-view stereoscopic display , 1997, Electronic Imaging.

[32]  Sung-Wook Min,et al.  Accommodative Response of Integral Imaging in Near Distance , 2012, Journal of Display Technology.

[33]  Levent Onural,et al.  Digital Holographic Three-Dimensional Video Displays , 2011, Proceedings of the IEEE.

[34]  G. Lippmann Epreuves reversibles donnant la sensation du relief , 1908 .

[35]  Gordon Wetzstein,et al.  Tensor displays , 2012, ACM Trans. Graph..

[36]  Mj Martin Bastiaans Wigner distribution function and its application to first-order optics , 1979 .

[37]  Adrian Stern Sampling of compact signals in offset linear canonical transform domains , 2007, Signal Image Video Process..

[38]  Sung-Wook Min,et al.  Wide-viewing-angle integral three-dimensional imaging system by curving a screen and a lens array. , 2005, Applied optics.

[39]  F. Durand,et al.  Antialiasing for Automultiscopic 3 D Displays , 2006 .

[40]  Sung-Wook Min,et al.  Multi-viewer tracking integral imaging system and its viewing zone analysis. , 2009, Optics express.

[41]  B. Javidi,et al.  Integral imaging with improved depth of field by use of amplitude-modulated microlens arrays. , 2004, Applied optics.

[42]  G. D. Francia Resolving Power and Information , 1955 .

[43]  Yasuhiro Takaki,et al.  Multi-view display module employing MEMS projector array. , 2012, Optics express.

[44]  Myungjin Cho,et al.  Three-Dimensional Optical Sensing and Visualization Using Integral Imaging , 2011, Proceedings of the IEEE.

[45]  Bahram Javidi,et al.  Depth and lateral size control of three-dimensional images in projection integral imaging. , 2004, Optics express.

[46]  Ramesh Raskar,et al.  Augmenting Light Field to model Wave Optics effects , 2009, ArXiv.

[47]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing - The Sparse Way, 3rd Edition , 2008 .

[48]  Per Capita,et al.  About the authors , 1995, Machine Vision and Applications.

[49]  Marcus Barkowsky,et al.  How visual fatigue and discomfort impact 3D-TV quality of experience: a comprehensive review of technological, psychophysical, and psychological factors , 2013, annals of telecommunications - annales des télécommunications.

[50]  J. Geng Three-dimensional display technologies. , 2013, Advances in optics and photonics.

[51]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[52]  Bahram Javidi,et al.  Shannon number and information capacity of three-dimensional integral imaging. , 2004, Journal of the Optical Society of America. A, Optics, image science, and vision.

[53]  A. Walther Radiometry and coherence , 1968 .

[54]  Bahram Javidi,et al.  High-resolution three-dimensional holographic display using dense ray sampling from integral imaging. , 2012, Optics letters.

[55]  Stephan Reichelt,et al.  Depth cues in human visual perception and their realization in 3D displays , 2010, Defense + Commercial Sensing.

[56]  Harry Shum,et al.  Plenoptic sampling , 2000, SIGGRAPH.

[57]  Hakan Urey,et al.  State of the Art in Stereoscopic and Autostereoscopic Displays , 2011, Proceedings of the IEEE.

[58]  Filippo Speranza,et al.  Stereoscopic 3D-TV: Visual Comfort , 2011, IEEE Transactions on Broadcasting.

[59]  Bahram Javidi,et al.  Three-Dimensional Image Sensing, Visualization, and Processing Using Integral Imaging , 2006, Proceedings of the IEEE.

[60]  L. Masotti,et al.  Three-dimensional imaging. , 1993, Clinics in diagnostic ultrasound.

[61]  Gozde Bozdagi Akar,et al.  Three-Dimensional Media for Mobile Devices , 2011, Proceedings of the IEEE.

[62]  Sung-Wook Min,et al.  Three-dimensional display technologies of recent interest: principles, status, and issues [Invited]. , 2011, Applied optics.

[63]  B. Javidi,et al.  Extended depth-of-field 3-D display and visualization by combination of amplitude-modulated microlenses and deconvolution tools , 2005, Journal of Display Technology.

[64]  Hyunkyung Kwon,et al.  A time-sequential multiview autostereoscopic display without resolution loss using a multi-directional backlight unit and an LCD panel , 2012, Electronic Imaging.

[65]  F. A. Miles Binocular Vision and Stereopsis by Ian P. Howard and Brian J. Rogers, Oxford University Press, 1995. £90.00 (736 pages) ISBN 0 19 508476 4. , 1996, Trends in Neurosciences.

[66]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[67]  Charles Wheatstone On some remarkable and hitherto unobserved phenomena of binocular vision. , 1962 .

[68]  B. Javidi,et al.  Large depth-of-focus time-multiplexed three-dimensional integral imaging by use of lenslets with nonuniform focal lengths and aperture sizes. , 2003 .

[69]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[70]  Tibor Balogh,et al.  The HoloVizio system , 2006, Electronic Imaging.

[71]  Homer H. Chen,et al.  Light Field Analysis for Modeling Image Formation , 2011, IEEE Transactions on Image Processing.

[72]  B. Javidi,et al.  Three-dimensional imaging methods based on multiview images , 2005, Journal of Display Technology.

[73]  Bahram Javidi,et al.  Three-dimensional integral imaging with large depth of focus by use of real and virtual image fields. , 2003, Optics letters.

[74]  S. Min,et al.  Multiple-viewing-zone integral imaging using a dynamic barrier array for three-dimensional displays. , 2003, Optics express.

[75]  Frédo Durand,et al.  4D frequency analysis of computational cameras for depth of field extension , 2009, SIGGRAPH '09.

[76]  Gordon Wetzstein,et al.  Compressive light field photography using overcomplete dictionaries and optimized projections , 2013, ACM Trans. Graph..

[77]  Nobuhiko Hata,et al.  High-quality integral videography using a multiprojector. , 2004, Optics express.

[78]  Bahram Javidi,et al.  Advances in three-dimensional integral imaging: sensing, display, and applications [Invited]. , 2013, Applied optics.

[79]  Touradj Ebrahimi,et al.  Towards reliable and reproducible 3D video quality assessment , 2011, Defense + Commercial Sensing.

[80]  S. Min,et al.  Theoretical analysis for three-dimensional integral imaging systems with double devices. , 2002, Applied optics.

[81]  Bahram Javidi,et al.  Improved viewing resolution of three-dimensional integral imaging by use of nonstationary micro-optics. , 2002, Optics letters.

[82]  K. Brenner,et al.  Ambiguity Function and Wigner Distribution Function Applied to Partially Coherent Imagery , 1984 .

[83]  Romain Cousseau,et al.  Subjective quality assessment of error concealment strategies for 3DTV in the presence of asymmetric transmission errors , 2010, 2010 18th International Packet Video Workshop.