A Distributed Cooperative Framework for Continuous Multi-Projector Pose Estimation

We present a novel calibration framework for multi-projector displays that achieves continuous geometric calibration by estimating and refining the poses of all projectors in an ongoing fashion during actual display use. Our framework provides scalability by operating as a distributed system of "intelligent" projector units: projectors augmented with rigidly-mounted cameras, and paired with dedicated computers. Each unit interacts asynchronously with its peers, leveraging their combined computational power to cooperatively estimate the poses of all of the projectors. In cases where the projection surface is static, our system is able to continuously refine all of the projector poses, even when they change simultaneously.

[1]  Marc Pollefeys,et al.  Auto-calibration of multi-projector display walls , 2004, ICPR 2004.

[2]  Ruigang Yang,et al.  PixelFlex: a reconfigurable multi-projector display system , 2001, Proceedings Visualization, 2001. VIS '01..

[3]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[4]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Aditi Majumder,et al.  Asynchronous Distributed Calibration for Scalable and Reconfigurable Multi-Projector Displays , 2006, IEEE Transactions on Visualization and Computer Graphics.

[6]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[7]  Henry Fuchs,et al.  Real-Time Projector Tracking on Complex Geometry Using Ordinary Imagery , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[9]  Aditi Majumder,et al.  PixelFlex 2 : A Comprehensive , Automatic , Casually-Aligned Multi-Projector Display , 2003 .

[10]  Ruigang Yang.  Automatic Projector Display Surface Estimation Using Every-Day Imagery , 2010 .

[11]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[12]  Henry Fuchs,et al.  RANSAC-Assisted Display Model Reconstruction for Projective Display , 2006, IEEE Virtual Reality Conference (VR 2006).

[13]  Oliver Bimber,et al.  Passive-Active Geometric Calibration for View-Dependent Projections onto Arbitrary Surfaces , 2007, J. Virtual Real. Broadcast..

[14]  Ruigang Yang,et al.  Multi-projector display with continuous self-calibration , 2008, PROCAMS '08.

[15]  Markus H. Gross,et al.  Adaptive Instant Displays: Continuously Calibrated Projections Using Per‐Pixel Light Control , 2005, Comput. Graph. Forum.

[16]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[17]  Linda G. Shapiro,et al.  Computer and Robot Vision (Volume II) , 2002 .

[18]  B. Tapley,et al.  Adaptive sequential estimation with unknown noise statistics , 1976 .

[19]  Markus H. Gross,et al.  Embedding imperceptible patterns into projected images for simultaneous acquisition and display , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.