Automatic Calibration of a Multiple-Projector Spherical Fish Tank VR Display

We describe a novel automatic calibration method using a single camera for a multiple-projector spherical Fish Tank Virtual Reality (FTVR) display. Modeling the projector as an inverse camera, we estimate the intrinsic and extrinsic projector parameters automatically using a set of projected images on the spherical screen. A calibrated camera is placed beneath to observe partially visible projected patterns. Using the correspondence between the observed pattern and the projected pattern, we reconstruct the shape of the spherical display and finally recover the 3D position of each projected pixel on the display. Additionally we present a practical calibration evaluation method that estimates on-surface accuracy using the single camera. We use point mismatch as a metric to describe misalignment and line mismatch to describe distortion. We demonstrate our automatic approach can achieve an on-surface point mismatch less than 1mm and line mismatch less than 1 on a 30cm diameter spherical screen. Taken together, our calibration approach and evaluation method are automatic and accurate for a desktop spherical FTVR and can be applied to other multiple-projector displays with curved screens.

[1]  Aditi Majumder,et al.  Autocalibration of Multiprojector CAVE-Like Immersive Environments , 2012, IEEE Transactions on Visualization and Computer Graphics.

[2]  Michael Harville,et al.  Practical Methods for Geometric and Photometric Correction of Tiled Projector , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[3]  Ian Stavness,et al.  Interactive Visual Calibration of Volumetric Head-Tracked 3D Displays , 2017, CHI.

[4]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[5]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[6]  Ravin Balakrishnan,et al.  Sphere: multi-touch interactions on a spherical display , 2008, UIST '08.

[7]  Yichen Tang,et al.  A 3D cubic puzzle in pCubee , 2011, 3DUI.

[8]  Roel Vertegaal,et al.  SnowGlobe: a spherical fish-tank VR display , 2011, CHI Extended Abstracts.

[9]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[10]  Rahul Sukthankar,et al.  Scalable alignment of large-format multi-projector displays using camera homography trees , 2002, IEEE Visualization, 2002. VIS 2002..

[11]  Sidney S. Fels,et al.  Analysis and Practical Minimization of Registration Error in a Spherical Fish Tank Virtual Reality System , 2016, ACCV.

[12]  W. Brent Seales,et al.  Multi-projector displays using camera-based registration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[13]  Aditi Majumder,et al.  Scalable Multi‐view Registration for Multi‐Projector Displays on Vertically Extruded Surfaces , 2010, Comput. Graph. Forum.

[14]  Marc Pollefeys,et al.  Auto-calibration of multi-projector display walls , 2004, ICPR 2004.

[15]  Marcelo Knörich Zuffo,et al.  Spheree: An interactive perspective-corrected spherical 3D display , 2014, 2014 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[16]  Ramesh Raskar,et al.  Immersive planar display using roughly aligned projectors , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[17]  Yichen Tang,et al.  The new pCubee: multi-touch perspective-corrected cubic display , 2014, CHI Extended Abstracts.

[18]  Jihun Cha,et al.  Geometric Correction for Uneven Quadric Projection Surfaces Using Recursive Subdivision of Bézier Patches , 2013 .

[19]  Gilbert Strang,et al.  Introduction to applied mathematics , 1988 .

[20]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[21]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Adam Finkelstein,et al.  Automatic alignment of high-resolution multi-projector display using an un-calibrated camera , 2000, IEEE Visualization.

[23]  Marcelo Knörich Zuffo,et al.  A Small-Scale and Flexible Platform for Multi-projector Systems Development , 2013, 2013 XV Symposium on Virtual and Augmented Reality.

[24]  N. Hurtós,et al.  Plane-based calibration of a projector-camera system , 2008 .

[25]  Aditi Majumder,et al.  PixelFlex 2 : A Comprehensive , Automatic , Casually-Aligned Multi-Projector Display , 2003 .

[26]  Jorge J. Moré,et al.  Computing a Trust Region Step , 1983 .

[27]  Florian Vogt,et al.  Cubee: a cubic 3D display for physics-based interaction , 2006, SIGGRAPH '06.

[28]  Ramesh Raskar,et al.  Multi-Projector Imagery on Curved Surfaces , 2003 .

[29]  Kellogg S. Booth,et al.  Evaluating 3D task performance for fish tank virtual worlds , 1993, TOIS.

[30]  Aditi Majumder,et al.  Automatic Registration of Multi‐Projector Domes Using a Single Uncalibrated Camera , 2011, Comput. Graph. Forum.

[31]  Gregg E. Favalora Volumetric 3D displays and application infrastructure , 2005, Computer.