Multifocal projection: a multiprojector technique for increasing focal depth

In this paper, we describe a novel multifocal projection concept that applies conventional video projectors and camera feedback. Multiple projectors with differently adjusted focal planes, but overlapping image areas are used. They can be either differently positioned in the environment or can be integrated into a single projection unit. The defocus created on an arbitrary surface is estimated automatically for each projector pixel. If this is known, a final image with minimal defocus can be composed in real-time from individual pixel contributions of all projectors. Our technique is independent of the surfaces' geometry, color and texture, the environment light, as well as of the projectors' position, orientation, luminance, and chrominance.

[1]  Christopher O. Jaynes,et al.  Camera-based detection and removal of shadows from interactive multiprojector displays , 2004, IEEE Transactions on Visualization and Computer Graphics.

[2]  Sang Ku Kim,et al.  Simultaneous Out-of-focus Blur Estimation And Restoration For A Digital Auto-focusing System , 1998, International 1998 Conference on Consumer Electronics.

[3]  Marc Levoy,et al.  Synthetic aperture confocal imaging , 2004, SIGGRAPH 2004.

[4]  Anselmo Lastra,et al.  Life-sized projector-based dioramas , 2001, VRST '01.

[5]  Frédo Durand,et al.  Defocus video matting , 2005, ACM Trans. Graph..

[6]  Ruigang Yang,et al.  Camera-based calibration techniques for seamless multiprojector displays , 2005, IEEE Transactions on Visualization and Computer Graphics.

[7]  Shree K. Nayar,et al.  Real-time focus range sensor , 1995, Proceedings of IEEE International Conference on Computer Vision.

[8]  Ming-Chao Chiang,et al.  Local blur estimation and super-resolution , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Takahiro Okabe,et al.  Radiometric Compensation in a Projector-Camera System Based Properties of Human Vision System , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[10]  Sam Kavusi,et al.  Computationally efficient algorithm for multifocus image reconstruction , 2003, IS&T/SPIE Electronic Imaging.

[11]  Mark Packer,et al.  Depth of focus. , 2008, Ophthalmology.

[12]  Shree K. Nayar,et al.  Microscopic shape from focus using active illumination , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[13]  C.-C. Chou,et al.  A fast focus measure for video display inspection , 2003, Machine Vision and Applications.

[14]  Shree K. Nayar,et al.  A Projection System with Radiometric Compensation for Screen Imperfections , 2003 .

[15]  Mongi A. Abidi,et al.  Object-based image restoration for multilayer autofocusing , 2004, IS&T/SPIE Electronic Imaging.

[16]  Greg Welch,et al.  COMPUTER GRAPHICS OPTIQUE Optical Superposition of Projected Computer Graphics , 2001, EGVE/IPT.

[17]  Oliver Bimber,et al.  Embedded entertainment with smart projectors , 2005, Computer.

[18]  Shree K. Nayar,et al.  A projector-camera system with real-time photometric adaptation for dynamic environments , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  Gordon Wetzstein,et al.  Enabling view-dependent stereoscopic projection in real environments , 2005, SIGGRAPH '05.

[20]  Paul A. Beardsley,et al.  Natural video matting using camera arrays , 2006, ACM Trans. Graph..

[21]  Marc Levoy,et al.  Synthetic aperture confocal imaging , 2004, ACM Trans. Graph..

[22]  Cedric Nishan Canagarajah,et al.  Image Fusion Using Complex Wavelets , 2002, BMVC.

[23]  Greg Welch,et al.  The office of the future: a unified approach to image-based modeling and spatially immersive displays , 1998, SIGGRAPH.