Extended Depth-of-Field Projector by Fast Focal Sweep Projection

A simple and cost-efficient method for extending a projector's depth-of-field (DOF) is proposed. By leveraging liquid lens technology, we can periodically modulate the focal length of a projector at a frequency that is higher than the critical flicker fusion (CFF) frequency. Fast periodic focal length modulation results in forward and backward sweeping of focusing distance. Fast focal sweep projection makes the point spread function (PSF) of each projected pixel integrated over a sweep period (IPSF; integrated PSF) nearly invariant to the distance from the projector to the projection surface as long as it is positioned within sweep range. This modulation is not perceivable by human observers. Once we compensate projection images for the IPSF, the projected results can be focused at any point within the range. Consequently, the proposed method requires only a single offline PSF measurement; thus, it is an open-loop process. We have proved the approximate invariance of the projector's IPSF both numerically and experimentally. Through experiments using a prototype system, we have confirmed that the image quality of the proposed method is superior to that of normal projection with fixed focal length. In addition, we demonstrate that a structured light pattern projection technique using the proposed method can measure the shape of an object with large depth variances more accurately than normal projection techniques.

[1]  G. Häusler,et al.  A method to increase the depth of focus by two step image processing , 1972 .

[2]  Shree K. Nayar,et al.  Transactions on Pattern Analysis and Machine Intelligence Flexible Depth of Field Photography 1 Depth of Field , 2022 .

[3]  Anselm Grundhöfer,et al.  Augmenting physical avatars using projector-based illumination , 2013, ACM Trans. Graph..

[4]  Shree K. Nayar,et al.  Focal sweep videography with deformable optics , 2013, IEEE International Conference on Computational Photography (ICCP).

[5]  Ramesh Raskar,et al.  Dynamic shader lamps : painting on movable objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.

[6]  Sheng Liu,et al.  Extended depth-of-field microscopic imaging with a variable focus microscope objective. , 2011, Optics express.

[7]  Kosuke Sato,et al.  Dynamic defocus and occlusion compensation of projected imagery by model-based optimal projector selection in multi-projection environment , 2011, Virtual Reality.

[8]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[9]  Jérôme Théau,et al.  Temporal Resolution , 2008, Encyclopedia of GIS.

[10]  Sing Bing Kang,et al.  Image Pre-compensation: Balancing Contrast and Ringing , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Oliver Bimber,et al.  Multifocal projection: a multiprojector technique for increasing focal depth , 2006, IEEE Transactions on Visualization and Computer Graphics.

[12]  Li Zhang,et al.  Projection defocus analysis for scene capture and image display , 2006, ACM Trans. Graph..

[13]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[14]  Gordon Wetzstein,et al.  The Visual Computing of Projector‐Camera Systems , 2008, SIGGRAPH '08.

[15]  Eduardo Fernández,et al.  Webvision: The Organization of the Retina and Visual System , 1995 .

[16]  Gordon Wetzstein,et al.  Coded aperture projection , 2008, SIGGRAPH '08.

[17]  K. Sato,et al.  Range imaging system utilizing nematic liquid crystal mask , 1987 .

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Michael S. Brown,et al.  Image Pre-Conditioning for Out-of-Focus Projector Blur , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).