Scalable Multi‐view Registration for Multi‐Projector Displays on Vertically Extruded Surfaces

Recent work have shown that it is possible to register multiple projectors on non‐planar surfaces using a single uncalibrated camera instead of a calibrated stereo pair when dealing with a special class of non‐planar surfaces, vertically extruded surfaces. However, this requires the camera view to contain the entire display surface. This is often an impossible scenario for large displays, especially common in visualization, edutainment, training and simulation applications. In this paper we present a new method that can achieve an accurate geometric registration even when the field‐of‐view of the uncalibrated camera can cover only a part of the vertically extruded display at a time. We pan and tilt the camera from a single point and employ a multi‐view approach to register the projectors on the display. This allows the method to scale easily both in terms of camera resolution and display size. To the best of our knowledge, our method is the first to achieve a scalable multi‐view geometric registration of large vertically extruded displays with a single uncalibrated camera. This method can also handle a different situation of having multiple similarly oriented cameras in different locations, if the camera focal length is known.

[1]  Ramesh Raskar,et al.  Quadric Transfer for Immersive Curved Screen Displays , 2004, Comput. Graph. Forum.

[2]  Marc Pollefeys,et al.  Auto-calibration of multi-projector display walls , 2004, ICPR 2004.

[3]  Henry Fuchs,et al.  Real-Time Projector Tracking on Complex Geometry Using Ordinary Imagery , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Daniel G. Aliaga Digital inspection: an interactive stage for viewing surface details , 2008, I3D '08.

[5]  Ruigang Yang,et al.  PixelFlex: a reconfigurable multi-projector display system , 2001, Proceedings Visualization, 2001. VIS '01..

[6]  Ruigang Yang,et al.  Real-time consensus-based scene reconstruction using commodity graphics hardware , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[7]  Aditi Majumder,et al.  Registration Techniques for Using Imperfect and Par tially Calibrated Devices in Planar Multi-Projector Displays , 2007, IEEE Transactions on Visualization and Computer Graphics.

[8]  Ruigang Yang Automatic Projector Display Surface Estimation Using Every-Day Imagery , 2010 .

[9]  Greg Welch,et al.  A Distributed Cooperative Framework for Continuous Multi-Projector Pose Estimation , 2009, 2009 IEEE Virtual Reality Conference.

[10]  MajumderAditi,et al.  Registration Techniques for Using Imperfect and Partially Calibrated Devices in Planar Multi-Projector Displays , 2007 .

[11]  Rahul Sukthankar,et al.  Scalable alignment of large-format multi-projector displays using camera homography trees , 2002, IEEE Visualization, 2002. VIS 2002..

[12]  Wei Sun,et al.  Calibrating multi-projector cylindrically curved displays for "wallpaper" projection , 2008, PROCAMS '08.

[13]  Daniel G. Aliaga,et al.  Photogeometric structured light: A self-calibrating and multi-viewpoint framework for accurate 3D modeling , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Markus H. Gross,et al.  Embedding imperceptible patterns into projected images for simultaneous acquisition and display , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[15]  Ruigang Yang,et al.  Real-time view synthesis using commodity graphics hardware , 2002, SIGGRAPH '02.

[16]  Meenakshisundaram Gopi,et al.  Color Seamlessness in Multi-Projector Displays Using Constrained Gamut Morphing , 2009, IEEE Transactions on Visualization and Computer Graphics.

[17]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[18]  Paul A. Beardsley,et al.  Natural video matting using camera arrays , 2006, ACM Trans. Graph..

[19]  Aditi Majumder,et al.  PixelFlex 2 : A Comprehensive , Automatic , Casually-Aligned Multi-Projector Display , 2003 .

[20]  Ruigang Yang,et al.  Camera-based calibration techniques for seamless multiprojector displays , 2005, IEEE Transactions on Visualization and Computer Graphics.

[21]  Ruigang Yang,et al.  Real‐Time Consensus‐Based Scene Reconstruction Using Commodity Graphics Hardware † , 2003, Comput. Graph. Forum.

[22]  Aditi Majumder,et al.  Asynchronous Distributed Calibration for Scalable and Reconfigurable Multi-Projector Displays , 2006, IEEE Transactions on Visualization and Computer Graphics.

[23]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[24]  W. Brent Seales,et al.  Multi-projector displays using camera-based registration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[25]  Oliver Bimber,et al.  Passive-Active Geometric Calibration for View-Dependent Projections onto Arbitrary Surfaces , 2007, J. Virtual Real. Broadcast..

[26]  Ruigang Yang,et al.  Multi-projector display with continuous self-calibration , 2008, PROCAMS '08.

[27]  Markus H. Gross,et al.  Adaptive Instant Displays: Continuously Calibrated Projections Using Per‐Pixel Light Control , 2005, Comput. Graph. Forum.

[28]  Aditi Majumder,et al.  Markerless View-Independent Registration of Multiple Distorted Projectors on Extruded Surfaces Using an Uncalibrated Camera , 2009, IEEE Transactions on Visualization and Computer Graphics.

[29]  Michael Harville,et al.  Practical Methods for Geometric and Photometric Correction of Tiled Projector , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[30]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..