Stereoscopy and the Human Visual System.

Stereoscopic displays have become important for many applications, including operation of remote devices, medical imaging, surgery, scientific visualization, and computer-assisted design. But the most significant and exciting development is the incorporation of stereo technology into entertainment: specifically, cinema, television, and video games. In these applications for stereo, three-dimensional (3D) imagery should create a faithful impression of the 3D structure of the scene being portrayed. In addition, the viewer should be comfortable and not leave the experience with eye fatigue or a headache. Finally, the presentation of the stereo images should not create temporal artifacts like flicker or motion judder. This paper reviews current research on stereo human vision and how it informs us about how best to create and present stereo 3D imagery. The paper is divided into four parts: (1) getting the geometry right, (2) depth cue interactions in stereo 3D media, (3) focusing and fixating on stereo images, and (4) how temporal presentation protocols affect flicker, motion artifacts, and depth distortion.

[1]  H H Bülthoff,et al.  Integration of depth modules: stereo and shading. , 1988, Journal of the Optical Society of America. A, Optics and image science.

[2]  D. Knill.  Learning Bayesian priors for depth perception. , 2007, Journal of vision.

[3]  Andrew B. Watson,et al.  Window of visibility: a psychophysical theory of fidelity in time-sampled visual motion displays , 1986 .

[4]  D. Knill.  Robust cue integration: a Bayesian model and evidence from cue-conflict studies with stereoscopic and figure cues to slant. , 2007, Journal of vision.

[5]  Rent M. Daum,et al.  CLINICAL MANAGEMENT OF BINOCULAR VISION: HETEROPHORIC, ACCOMMODATIVE AND EYE MOVEMENT DISORDERS , 1994 .

[6]  David C. Burr,et al.  How does binocular delay give information about depth? , 1979, Vision Research.

[7]  J E Sheedy,et al.  Phoria, Vergence, and Fixation Disparity in Oculomotor Problems , 1977, American journal of optometry and physiological optics.

[8]  Charless C. Fowlkes,et al.  Natural-Scene Statistics Predict How the Figure–Ground Cue of Convexity Affects Human Depth Perception , 2010, The Journal of Neuroscience.

[9]  Martin S. Banks,et al.  Extra-retinal and perspective cues cause the small range of the induced effect , 1998, Vision Research.

[10]  M F Bradshaw,et al.  Vertical disparities, differential perspective and binocular stereopsis , 1993, Nature.

[11]  W. N. Charman,et al.  Pupil Diameter and the Depth-of-field of the Human Eye as Measured by Laser Speckle , 1977 .

[12]  M. Mon-Williams,et al.  Health issues with virtual reality displays: what we do know and what we don't , 1997, COMG.

[13]  J. C. Kotulak,et al.  Dynamic interactions between accommodation and convergence are velocity sensitive , 1986, Vision Research.

[14]  James A. Crowell,et al.  Horizontal and vertical disparity, eye position, and stereoscopic slant perception , 1999, Vision Research.

[15]  M F Bradshaw,et al.  Disparity Minimisation, Cyclovergence, and the Validity of Nonius Lines as a Technique for Measuring Torsional Alignment , 1999, Perception.

[16]  Wendy J Adams,et al.  Bayesian modeling of cue interaction: bistability in stereoscopic slant perception. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  Masaki Emoto,et al.  Two factors in visual fatigue caused by stereoscopic HDTV images , 2004 .

[18]  D. H. Kelly.  Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[19]  Hiroshi Ando,et al.  Effects of head motion and stereo viewing on perceived glossiness. , 2010, Journal of vision.

[20]  M. Goulding,et al.  Erratum: Lbx1 and Tlx3 are opposing switches in determining GABAergic versus glutamatergic transmitter phenotypes , 2005, Nature Neuroscience.

[21]  Per Capita,et al.  About the authors , 1995, Machine Vision and Applications.

[22]  Andrew Glennerster,et al.  Latitude and longitude vertical disparities. , 2009, Journal of vision.

[23]  Rory A. Fisher,et al.  Theory of Statistical Estimation , 1925, Mathematical Proceedings of the Cambridge Philosophical Society.

[24]  Kevin J. MacKenzie,et al.  Vergence and accommodation to multiple-image-plane stereoscopic displays: 'Real world' responses with practical image-plane separations? , 2011, Electronic Imaging.

[25]  T. Meese,et al.  Performance data indicate summation for pictorial depth-cues in slanted surfaces. , 2004, Spatial vision.

[26]  S K Rushton,et al.  Developing visual systems and exposure to virtual reality and stereo displays: some concerns and speculations about the demands on accommodation and vergence. , 1999, Applied ergonomics.

[27]  M. Banks,et al.  Estimator Reliability and Distance Scaling in Stereoscopic Slant Perception , 1999, Perception.

[28]  Kenneth N. Ogle,et al.  INDUCED SIZE EFFECT: I. A NEW PHENOMENON IN BINOCULAR SPACE PERCEPTION ASSOCIATED WITH THE RELATIVE SIZES OF THE IMAGES OF THE TWO EYES , 1938 .

[29]  James M. Hillis,et al.  Slant from texture and disparity cues: optimal cue combination. , 2004, Journal of vision.

[30]  I. Howard,et al.  Temporal Aspects of Slant and Inclination Perception , 1998, Perception.

[31]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[32]  W. D. Wright.  Physiological Optics , 1958, Nature.

[33]  Robert S. Allison,et al.  The dynamics of vertical vergence , 1997, Experimental Brain Research.

[34]  B. Rogers,et al.  The effect of display size on disparity scaling from differential perspective and vergence cues , 1996, Vision Research.

[35]  James Gao,et al.  High-speed switchable lens enables the development of a volumetric stereoscopic display. , 2009, Optics express.

[36]  George Mather,et al.  Depth cue integration: stereopsis and image blur , 2000, Vision Research.

[37]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[38]  B. Julesz.  Binocular depth perception of computer-generated patterns , 1960 .

[39]  Maurizio Ardito.  Studies of the Influence of Display Size and Picture Brightness on the Preferred Viewing Distance for HDTV Programs , 1994 .

[40]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[41]  Sheng Liu,et al.  An optical see-through head mounted display with addressable focal planes , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[42]  Martin S. Banks,et al.  Misperceptions in stereoscopic displays: a vision science perspective , 2008, APGV '08.

[43]  Hans-Peter Seidel,et al.  Real-time lens blur effects and focus control , 2010, SIGGRAPH 2010.

[44]  I. P. Howard,et al.  Effects of stimulus size and eccentricity on horizontal and vertical vergence , 2000, Experimental Brain Research.

[45]  James F. O'Brien,et al.  Using blur to affect perceived distance and size , 2010, TOGS.

[46]  James J. Clark,et al.  Data Fusion for Sensory Information Processing Systems , 1990 .

[47]  J. Porrill,et al.  Stereopsis, vertical disparity and relief transformations , 1995, Vision Research.

[48]  B. Anderson.  Depth perception , 2008 .

[49]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, ACM Trans. Graph..

[50]  Robert S. Allison,et al.  Analysis of the influence of vertical disparities arising in Toed-in stereoscopic cameras , 2007 .

[51]  Induced size effect. I : A new phenomenon in binocular vision associated with the relative sizes of the images in the two eyes , 1938 .

[52]  Mtm Marc Lambooij,et al.  Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review , 2009 .

[53]  Martin S Banks,et al.  Temporal presentation protocols in stereoscopic displays: Flicker visibility, perceived motion, and perceived depth , 2011, Journal of the Society for Information Display.

[54]  R. S Allison,et al.  Depth selectivity of vertical fusional mechanisms , 2000, Vision Research.

[55]  Inna Tsirlin,et al.  Stereoscopic transparency: constraints on the perception of multiple surfaces. , 2008, Journal of vision.

[56]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[57]  James M. Hillis,et al.  Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses , 2002, Science.

[58]  F. Okano,et al.  Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television , 2005, Journal of Display Technology.

[59]  Bernard Mendiburu,et al.  3D Movie Making: Stereoscopic Digital Cinema from Script to Screen , 2009 .

[60]  Kevin J. MacKenzie,et al.  Vergence and accommodation to multiple-image-plane stereoscopic displays: "real world" responses with practical image-plane separations? , 2012, J. Electronic Imaging.

[61]  R. S Allison,et al.  Temporal dependencies in resolving monocular and binocular cue conflict in slant perception , 2000, Vision Research.

[62]  Mel W. Siegel,et al.  Just enough reality: comfortable 3-D viewing via microstereopsis , 2000, IEEE Trans. Circuits Syst. Video Technol..

[63]  Ahna R Girshick,et al.  Probabilistic combination of slant information: weighted averaging and robustness as optimal percepts. , 2009, Journal of vision.

[64]  Tom Geller,et al.  Overcoming the Uncanny Valley , 2008, IEEE Computer Graphics and Applications.

[65]  M. Morgan,et al.  Perception of continuity in stroboscopic motion: A temporal frequency analysis , 1979, Vision Research.

[66]  C. WILLIAM TYLER,et al.  Depth perception in disparity gratings , 1974, Nature.

[67]  Xiao-Fan Feng.  LCD motion-blur analysis, perception, and reduction using synchronized backlight flashing , 2006, Electronic Imaging.

[68]  E. Brenner,et al.  Testing a counter-intuitive prediction of optimal cue combination , 2009, Vision Research.

[69]  M. Landy,et al.  Measurement and modeling of depth cue combination: in defense of weak fusion , 1995, Vision Research.

[70]  Ahna R Girshick,et al.  Perception of 3‐D Layout in Stereo Displays , 2009, Information display.

[71]  Kevin J. MacKenzie,et al.  Accommodation to multiple-focal-plane displays: Implications for improving stereoscopic displays and for accommodation control. , 2010, Journal of vision.

[72]  Campbell Fw.  A method for measuring the depth of field of the human eye. , 1954 .

[73]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[74]  Leo Jan Velthoven,et al.  Motion blur reduction for liquid crystal displays: motion-compensated inverse filtering , 2004, IS&T/SPIE Electronic Imaging.

[75]  David M. Hoffman,et al.  The zone of comfort: Predicting visual discomfort with stereo displays. , 2011, Journal of vision.

[76]  A. Fitzgibbon,et al.  Humans Ignore Motion and Stereo Cues in Favor of a Fictional Stable World , 2006, Current Biology.