Stereoscopic Cinema

Stereoscopic cinema has seen a surge of activity in recent years, and for the first time all of the major Hollywood studios released 3-D movies in 2009. This is happening alongside the adoption of 3-D technology for sports broadcasting, and the arrival of 3-D TVs for the home. Two previous attempts to introduce 3-D cinema in the 1950s and the 1980s failed because the contemporary technology was immature and resulted in viewer discomfort. But current technologies – such as accurately-adjustable 3-D camera rigs with onboard computers to automatically inform a camera operator of inappropriate stereoscopic shots, digital processing for post-shooting rectification of the 3-D imagery, digital projectors for accurate positioning of the two stereo projections on the cinema screen, and polarized silver screens to reduce cross-talk between the viewers left-and right-eyes – mean that the viewer experience is at a much higher level of quality than in the past. Even so, creation of stereoscopic cinema is an open, active research area, and there are many challenges from acquisition to post-production to automatic adaptation for different-sized display. This chapter describes the current state-of-the-art in stereo-scopic cinema, and directions of future work.

[1]  Kenneth N. Ogle,et al.  INDUCED SIZE EFFECT: I. A NEW PHENOMENON IN BINOCULAR SPACE PERCEPTION ASSOCIATED WITH THE RELATIVE SIZES OF THE IMAGES OF THE TWO EYES , 1938 .

[2]  S. Freguia.  Researches in Binocular Vision. , 1950 .

[3]  Charles Smith,et al.  Basic Principles of the Three-Dimensional Film , 1952 .

[4]  Campbell Fw.  A method for measuring the depth of field of the human eye. , 1954 .

[5]  H. Bülthoff,et al.  Does the brain know the physics of specular reflection? , 1990, Nature.

[6]  Y. Yeh,et al.  Limits of Fusion and Depth Judgment in Stereoscopic Color Displays , 1990, Human factors.

[7]  A Blake,et al.  Shape from specularities: computation and psychophysics. , 1991, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[8]  S. Pastoor.  Human factors of 3DTV: an overview of current research at Heinrich-Hertz-Institut Berlin , 1992 .

[9]  Andrew J. Woods,et al.  Image distortions in stereoscopic video systems , 1993, Electronic Imaging.

[10]  M F Bradshaw,et al.  Vertical disparities, differential perspective and binocular stereopsis , 1993, Nature.

[11]  Mark Mon-Williams,et al.  Natural problems for stereoscopic depth perception in virtual environments , 1995, Vision Research.

[12]  Scott B. Stevenson,et al.  Human stereo matching is not restricted to epipolar lines , 1997, Vision Research.

[13]  M. Mon-Williams,et al.  Health issues with virtual reality displays: what we do know and what we don't , 1997, COMG.

[14]  Susana Marcos,et al.  The depth-of-field of the human eye from objective and subjective measurements , 1999, Vision Research.

[15]  Charles T. Loop,et al.  Computing rectifying homographies for stereo vision , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  I. Sexton,et al.  Stereoscopic and autostereoscopic display systems , 1999, IEEE Signal Process. Mag..

[17]  Emanuele Trucco,et al.  A compact algorithm for rectification of stereo pairs , 2000, Machine Vision and Applications.

[18]  André Vincent,et al.  Human perception of mismatched stereoscopic 3D inputs , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[19]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[20]  Lenny Lipton.  The stereoscopic cinema: From film to Digital projection , 2001 .

[21]  Andrew W. Fitzgibbon,et al.  Simultaneous linear estimation of multiple view geometry and lens distortion , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Marcel P. Lucassen,et al.  Visual comfort of binocular and 3D displays , 2001, IS&T/SPIE Electronic Imaging.

[23]  Andrew Gardner,et al.  A lighting reproduction approach to live-action compositing , 2002, SIGGRAPH.

[24]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[25]  Filippo Speranza,et al.  Visual comfort and apparent depth in 3D systems: effects of camera convergence distance , 2002, SPIE ITCom.

[26]  Tomás Pajdla,et al.  Estimation of omnidirectional camera model from epipolar geometry , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[27]  Filippo Speranza,et al.  Improving the visual comfort of stereoscopic images , 2003, IS&T/SPIE Electronic Imaging.

[28]  Robert S Allison,et al.  Geometric and induced effects in binocular stereopsis and motion parallax , 2003, Vision Research.

[29]  James T Todd,et al.  The visual perception of 3-D shape from multiple cues: Are observers capable of perceiving metric structure? , 2003, Perception & psychophysics.

[30]  J. Todd.  Review TRENDS in Cognitive Sciences Vol.8 No.3 March 2004 The visual perception of 3D shape q , 2022 .

[31]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[32]  M. Bertalmío,et al.  Real-time, accurate depth of field using anisotropic diffusion and programmable graphics cards , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[33]  Martin S. Banks,et al.  A stereo display prototype with multiple focal distances , 2004, ACM Trans. Graph..

[34]  Robert S. Allison.  The camera convergence problem revisited , 2004, IS&T/SPIE Electronic Imaging.

[35]  Masaki Emoto,et al.  Two factors in visual fatigue caused by stereoscopic HDTV images , 2004 .

[36]  Richard Szeliski,et al.  Boundary Matting for View Synthesis , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[37]  Chung-Hyun Ahn,et al.  Virtual Control of Optical Axis of the 3DTV Camera for Reducing Visual Fatigue in Stereoscopic 3DTV , 2004 .

[38]  Richard I. Hartley,et al.  Theory and Practice of Projective Rectification , 1999, International Journal of Computer Vision.

[39]  Wolfgang Förstner,et al.  Fish-Eye-Stereo Calibration and Epipolar Rectification , 2005 .

[40]  M. Ernst,et al.  Focus cues affect perceived depth. , 2005, Journal of vision.

[41]  Kostas Daniilidis,et al.  Fundamental matrix for cameras with radial distortion , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[42]  F. Okano,et al.  Repeated vergence adaptation causes the decline of visual functions in watching stereoscopic television , 2005, Journal of Display Technology.

[43]  Hideaki Kimata,et al.  Development of MPEG standards for 3D and free viewpoint video , 2005, SPIE Optics East.

[44]  Adrian Hilton,et al.  A Comparative Study of Free-Viewpoint Video Techniques For sports events , 2006 .

[45]  Baoxin Li,et al.  Rectification with Intersecting Optical Axes for Stereoscopic Visualization , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[46]  Wijnand A. IJsselsteijn,et al.  Perceived quality of compressed stereoscopic images: Effects of symmetric and asymmetric JPEG coding and camera separation , 2006, TAP.

[47]  Bruce G Cumming,et al.  Does depth perception require vertical-disparity detectors? , 2006, Journal of vision.

[48]  Andrew Blake,et al.  Efficient Dense Stereo with Occlusions for New View-Synthesis by Four-State Dynamic Programming , 2006, International Journal of Computer Vision.

[49]  Christopher O. Jaynes,et al.  Overconstrained Linear Estimation of Radial Distortion and Multi-view Geometry , 2006, ECCV.

[50]  Makoto Okui,et al.  Geometrical analysis of puppet-theater and cardboard effects in stereoscopic HDTV images , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[51]  Masaki Emoto,et al.  Spatial distortion prediction system for stereoscopic images , 2006, J. Electronic Imaging.

[52]  Andrew Jones,et al.  Relighting human locomotion with flowed reflectance fields , 2006, EGSR '06.

[53]  Wa Wijnand IJsselsteijn,et al.  Visual discomfort in stereoscopic displays: a review , 2007, Electronic Imaging.

[54]  Andrew W. Fitzgibbon,et al.  On New View Synthesis Using Multiview Stereo , 2007, BMVC.

[55]  Huei-Yung Lin,et al.  Photo-Realistic Depth-of-Field Effects Synthesis Based on Real Camera Parameters , 2007, ISVC.

[56]  Hsien-Huang P. Wu,et al.  Projective Rectification with Minimal Geometric Distortion , 2007 .

[57]  Robert S. Allison,et al.  Analysis of the influence of vertical disparities arising in Toed-in stereoscopic cameras , 2007 .

[58]  Wei Xiong,et al.  Stereo Matching on Objects with Fractional Boundary , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[59]  Tomoyuki Nishita,et al.  Interactive Simulation of the Human Eye Depth of Field and Its Correction by Spectacle Lenses , 2007, Comput. Graph. Forum.

[60]  Yuichi Taguchi,et al.  Stereo reconstruction with mixed pixels using adaptive over-segmentation , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[61]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[62]  Ruigang Yang,et al.  Stereoscopic inpainting: Joint color and depth completion from stereo images , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[63]  Peter A. Howarth,et al.  Visual fatigue caused by viewing stereoscopic motion images: Background, theories, and observations , 2008, Displays.

[64]  Nick Holliman,et al.  Stereoscopic image quality metrics and compression , 2008, Electronic Imaging.

[65]  Nick Rombes.  Stereoscopic Cinema and the Origins of 3-D Film, 1838–1952 (review) , 2008 .

[66]  Wei Xiong,et al.  Fractional Stereo Matching Using Expectation-Maximization , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  Bernard Mendiburu,et al.  3D Movie Making: Stereoscopic Digital Cinema from Script to Screen , 2009 .

[68]  Gauthier Lafruit,et al.  Real-time stereo-based view synthesis algorithms: A unified framework and evaluation on commodity GPUs , 2009, Signal Process. Image Commun..

[69]  C. Rother,et al.  A stereo approach that handles the matting problem via image warping , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[70]  Geng Sun,et al.  Evaluating methods for controlling depth perception in stereoscopic cinematography , 2009, Electronic Imaging.

[71]  Pete Kozachik.  2 Worlds in 3 Dimensions , 2009 .

[72]  Self Image Rectification for Uncalibrated Stereo Video with Varying Camera Motions and Zooming Effects , 2009, MVA.

[73]  Richard P. Wildes,et al.  Coarse-to-fine stereo vision with accurate 3D boundaries , 2010, Image Vis. Comput..

[74]  James F. O'Brien,et al.  Using blur to affect perceived distance and size , 2010, TOGS.