Screen-Camera Calibration Using Gray Codes

In this paper we present a method for efficient calibration of a screen-camera setup, in which the camera is not directly facing the screen. A spherical mirror is used to make the screen visible to the camera. Using Gray code illumination patterns, we can uniquely identify the reflection of each screen pixel on the imaged spherical mirror. This allows us to compute a large set of 2D-3D correspondences, using only two sphere locations. Compared to previous work, this means we require less manual interventions, combined with a more robust screen pixel detection scheme. This results in a consistent improvement in accuracy, which we illustrate with experiments on both synthetic and real data.

[1]  David Salesin,et al.  Environment matting and compositing , 1999, SIGGRAPH.

[2]  Yi-Ping Hung,et al.  Video-based eye tracking for autostereoscopic displays , 2001 .

[3]  Pat Hanrahan,et al.  A signal-processing framework for inverse rendering , 2001, SIGGRAPH.

[4]  Kostas Daniilidis,et al.  Catadioptric Projective Geometry , 2001, International Journal of Computer Vision.

[5]  Pieter Peers,et al.  Rapid Acquisition of Specular and Diffuse Normal Maps from Polarized Spherical Gradient Illumination , 2007 .

[6]  Kiriakos N. Kutulakos,et al.  A Theory of Refractive and Specular 3D Shape by Light-Path Triangulation , 2005, ICCV.

[7]  Hans-Peter Seidel,et al.  3D acquisition of mirroring objects using striped patterns , 2005, Graph. Model..

[8]  Elaina Andrews,et al.  I , 2020 .

[9]  Yasuyuki Matsushita,et al.  Radiometric calibration using temporal irradiance mixtures , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Richard I. Hartley,et al.  In Defense of the Eight-Point Algorithm , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Philippe Bekaert,et al.  Fast Normal Map Acquisition Using an LCD Screen Emitting Gradient Patterns , 2008, 2008 Canadian Conference on Computer and Robot Vision.

[12]  Dmitry O. Gorodnichy Nouse ‘Use Your Nose as a Mouse’ – a New Technology for Hands-free Games and Interfaces , 2002 .

[13]  Philippe Bekaert,et al.  Screen-Camera Calibration using a Spherical Mirror , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).

[14]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[15]  Kiriakos N. Kutulakos,et al.  Reconstructing the Surface of Inhomogeneous Transparent Scenes by Scatter-Trace Photography , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[17]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[18]  Ziad Hatab,et al.  Sixteen-megabit dynamic random access memory trench depth characterization using two-dimensional diffraction analysis , 1995 .

[19]  Shree K. Nayar,et al.  Multiview radial catadioptric imaging for scene capture , 2006, SIGGRAPH 2006.

[20]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[21]  Tim Weyrich,et al.  Dense 3D reconstruction from specularity consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Philippe Bekaert,et al.  A Prototype for Practical Eye-Gaze Corrected Video Chat on Graphics Hardware , 2018, SIGMAP.

[23]  James J. Clark Photometric Stereo with Nearby Planar Distributed Illuminants , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[24]  Philippe Bekaert,et al.  High quality mesostructure acquisition using specularities , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Pau Gargallo,et al.  General Specular Surface Triangulation , 2006, ACCV.

[26]  Gerhard Roth,et al.  Nouse 'Use Your Nose as a Mouse' - a New Technology for Hands-free Games and Interfaces , 2002 .

[27]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[28]  Douglas Lanman,et al.  Reconstructing a 3D Line from a Single Catadioptric Image , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[29]  Yee-Hong Yang,et al.  Using a Raster Display for Photometric Stereo , 2007, Fourth Canadian Conference on Computer and Robot Vision (CRV '07).