A Multi-Projector Calibration Method for Virtual Reality Simulators with Analytically Defined Screens

The geometric calibration of projectors is a demanding task, particularly for the industry of virtual reality simulators. Different methods have been developed during the last decades to retrieve the intrinsic and extrinsic parameters of projectors, most of them being based on planar homographies and some requiring an extended calibration process. The aim of our research work is to design a fast and user-friendly method to provide multi-projector calibration on analytically defined screens, where a sample is shown for a virtual reality Formula 1 simulator that has a cylindrical screen. The proposed method results from the combination of surveying, photogrammetry and image processing approaches, and has been designed by considering the spatial restrictions of virtual reality simulators. The method has been validated from a mathematical point of view, and the complete system—which is currently installed in a shopping mall in Spain—has been tested by different users.

[1]  C.-F. Chen,et al.  A target-adapted geometric calibration method for camera-projector system , 2010, 2010 25th International Conference of Image and Vision Computing New Zealand.

[2]  C. Portalés,et al.  Calibration of a camera–projector monochromatic system , 2015 .

[3]  Aditi Majumder,et al.  Markerless View-Independent Registration of Multiple Distorted Projectors on Extruded Surfaces Using an Uncalibrated Camera , 2009, IEEE Transactions on Visualization and Computer Graphics.

[4]  Aditi Majumder,et al.  Auto-calibration of cylindrical multi-projector systems , 2010, 2010 IEEE Virtual Reality Conference (VR).

[5]  Rüdiger Dillmann,et al.  Calibration issues for projector-based 3D-scanning , 2004, Proceedings Shape Modeling Applications, 2004..

[6]  Joaquim Salvi,et al.  Planar-based camera-projector calibration , 2011, 2011 7th International Symposium on Image and Signal Processing and Analysis (ISPA).

[7]  Xu Liu,et al.  Automatic geometrical calibration for multiprojector-type light field three-dimensional display , 2014 .

[8]  Youfu Li,et al.  Self-recalibration of a structured light system via plane-based homography , 2007, Pattern Recognit..

[9]  A. Dermanis.  Free network solutions with the DLT method , 1994 .

[10]  Rahul Sukthankar,et al.  Scalable alignment of large-format multi-projector displays using camera homography trees , 2002, IEEE Visualization, 2002. VIS 2002..

[11]  V. A. Knyaz.  AUTOMATED CALIBRATION TECHNIQUE FOR PHOTOGRAMMETRIC SYSTEM BASED ON A MULTI-MEDIA PROJECTOR AND A CCD CAMERA , 2006 .

[12]  Michael Harville,et al.  Practical Methods for Geometric and Photometric Correction of Tiled Projector , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[13]  Duane C. Brown,et al.  Close-Range Camera Calibration , 1971 .

[14]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Meyer Nahon,et al.  Simulator motion-drive algorithms - A designer's perspective , 1990 .

[16]  Marc Pollefeys,et al.  Auto-calibration of multi-projector display walls , 2004, ICPR 2004.

[17]  Gabriel Taubin,et al.  Simple, Accurate, and Robust Projector-Camera Calibration , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[18]  Takayuki Okatani,et al.  Autocalibration of an Ad Hoc Construction of Multi-Projector Displays , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[19]  Ruigang Yang,et al.  Camera-based calibration techniques for seamless multiprojector displays , 2005, IEEE Transactions on Visualization and Computer Graphics.

[20]  W. Brent Seales,et al.  Multi-projector displays using camera-based registration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[21]  Takeo Kanade,et al.  Projector Calibration using Arbitrary Planes and Calibrated Camera , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Jiangtao Xi,et al.  Accurate projector calibration based on a new point-to-point mapping relationship between the camera and projector images , 2015 .

[23]  Lu Zhao,et al.  The auto‐geometric correction of multi‐projector for cylindrical surface using Bézier patches , 2014 .

[24]  Mark Ashdown,et al.  Steerable Projector Calibration , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[25]  Lilong Cai,et al.  A calibration method for uncoupling projector and camera of a structured light system , 2008, 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[26]  Sébastien Roy,et al.  Multi-projectors for arbitrary surfaces without explicit calibration nor reconstruction , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[27]  Wei Hong,et al.  Automatic calibration of a projector-camera system with a see-through screen , 2012, 2012 19th IEEE International Conference on Image Processing.

[28]  Soon-Yong Park,et al.  Active Calibration of Camera-Projector Systems Based on Planar Homography , 2010, 2010 20th International Conference on Pattern Recognition.

[29]  Wei Sun,et al.  Calibrating multi-projector cylindrically curved displays for "wallpaper" projection , 2008, PROCAMS '08.

[30]  Radu Orghidan,et al.  Structured light self-calibration with vanishing points , 2013, Machine Vision and Applications.