Adaptive Instant Displays: Continuously Calibrated Projections Using Per‐Pixel Light Control

We present a framework for achieving user-defined on-demand displays in setups containing bricks of movable cameras and DLP-projectors. A dynamic calibration procedure is introduced, which handles cameras and projectors in a unified way and allows continuous flexible setup changes, while seamless projection alignment and blending is performed simultaneously. For interaction, an intuitive laser pointer based technique is developed, which can be combined with real-time 3D information acquired from the scene. All these tasks can be performed concurrently with the display of a user-chosen application in a non-disturbing way. This is achieved by using an imperceptible structured light approach enabling pixel-based surface light control suited for a wide range of computer graphics and vision algorithms. To ensure scalability of light control in the same working space, multiple projectors are multiplexed.

[1]  Kai Li,et al.  Building a scalable high-resolution display wall , 2001 .

[2]  Michitaka Hirose,et al.  Projected augmentation - augmented reality using rotatable video projectors , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[3]  André Oosterlinck,et al.  Range Image Acquisition with a Single Binary-Encoded Light Pattern , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Zhengyou Zhang,et al.  Self-maintaining camera calibration over time , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Rahul Sukthankar,et al.  Smarter Presentations: Exploiting Homography in Camera-Projector Systems , 2001, ICCV.

[6]  Rahul Sukthankar,et al.  Scalable alignment of large-format multi-projector displays using camera homography trees , 2002, IEEE Visualization, 2002. VIS 2002..

[7]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[8]  Rahul Sukthankar,et al.  Self-Calibrating Camera-Assisted Presentation Interface , 2000 .

[9]  Richard Hartley,et al.  Minimizing algebraic error , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[10]  Paul A. Beardsley,et al.  Natural video matting using camera arrays , 2006, ACM Trans. Graph..

[11]  Kostas Daniilidis,et al.  Wide Area Multiple Camera Calibration and Estimation of Radial Distortion , 2004 .

[12]  Claudio S. Pinhanez.  Using a steerable projector and a camera to transform surfaces into interactive displays , 2001, CHI Extended Abstracts.

[13]  Greg Humphreys,et al.  Chromium: a stream-processing framework for interactive rendering on clusters , 2002, SIGGRAPH.

[14]  Marc Pollefeys,et al.  Auto-calibration of multi-projector display walls , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[15]  Mark Ashdown,et al.  A flexible projector-camera system for multi-planar displays , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[16]  Jason Nieh,et al.  The Performance of Remote Display Mechanisms for Thin-Client Computing , 2002, USENIX Annual Technical Conference, General Track.

[17]  Aditi Majumder,et al.  PixelFlex 2 : A Comprehensive , Automatic , Casually-Aligned Multi-Projector Display , 2003 .

[18]  Chia-Hsiang Menq,et al.  Digital Projector Calibration for 3-D Active Vision Systems , 2002 .

[19]  Jason Nieh,et al.  Measuring thin-client performance using slow-motion benchmarking , 2001, TOCS.

[20]  Roger Tsai,et al.  Synopsis of recent progress on camera calibration for 3D machine vision , 1989 .

[21]  Greg Welch,et al.  Efficient Image Generation for Multiprojector and Multisurface Displays , 1998, Rendering Techniques.

[22]  Adam Finkelstein,et al.  Building and Using A Scalable Display Wall System , 2000, IEEE Computer Graphics and Applications.

[23]  Olivier D. Faugeras,et al.  A theory of self-calibration of a moving camera , 1992, International Journal of Computer Vision.

[24]  Robert Ulichney.  Method for Increasing Apparent Amplitude Resolution , and Correcting Luminance Nonuniformity in Projected Displays , 2003 .

[25]  Xing Chen,et al.  Lumipoint: multi-user laser-based interaction on large tiled displays , 2002 .

[26]  Rudolf Mester,et al.  Subspace Methods and Equilibration in Computer Vision , 1999 .

[27]  Rajeev J. Surati.  Scalable self-calibrating display technology for seamless large-scale displays , 1999 .

[28]  Gene H. Golub,et al.  Matrix computations , 1983 .

[29]  Aditi Majumder,et al.  Perceptual photometric seamlessness in projection-based tiled displays , 2005, TOGS.

[30]  D. M. Germans,et al.  Realizing a Stereo Tiled Display Using Commodity Components , .

[31]  Rachid Deriche,et al.  Camera Self-Calibration Using the Kruppa Equations and the SVD of the Fundamental Matrix: The Case of Varying Intrinsic Parameters , 2000 .

[32]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.

[33]  Youfu Li,et al.  Self-recalibration of a colour-encoded light system for automated three-dimensional measurements , 2003 .

[34]  Andy Hopper,et al.  Virtual Network Computing , 1998, IEEE Internet Comput..

[35]  Markus H. Gross,et al.  Embedding imperceptible patterns into projected images for simultaneous acquisition and display , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[36]  Mario Baldi,et al.  WinPcap: una libreria Open Source per l'analisi di rete , 2003 .

[37]  Marcus A. Magnor,et al.  External Camera Calibration for Synchronized Multi-video Systems , 2004, WSCG.

[38]  Rick Stevens,et al.  DottyToto: a measurement engine for aligning multiprojector display systems , 2003, IS&T/SPIE Electronic Imaging.

[39]  Philipp Slusallek,et al.  Wide area camera calibration using virtual calibration objects , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[40]  Henri E. Bal,et al.  Retained Mode Parallel Renering for Scalable Tiled Displays , 2002 .

[41]  W. Brent Seales,et al.  Multi-projector displays using camera-based registration , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[42]  Richard I. Hartley,et al.  In defence of the 8-point algorithm , 1995, Proceedings of IEEE International Conference on Computer Vision.

[43]  Andreas Butz,et al.  SearchLight - A Lightweight Search Function for Pervasive Environments , 2004, Pervasive.