Focus Range Sensors

Structures of dynamic scenes can only be recovered using a real-time range sensor. Focus analysis offers a direct solution to fast and dense range estimation. It is computational efficient as it circumvents the correspondence problem faced by stereo and feature tracking in structure from motion. However, accurate depth estimation requires theoretical and practical solutions to a variety of problems including recovery of textureless surfaces, precise blur estimation, and magnification variations caused by defocusing. Both textured and textureless surfaces are recovered using an illumination pattern that is projected via the same optical path used to acquire images. The illumination pattern is optimized to ensure maximum accuracy and spatial resolution in computed depth. A prototype focus range sensor has been developed that produces up to 512×480 depth estimates at 30 Hz with an accuracy better than 0.3%. In addition, a microscopic shape from focus sensor is described that uses the derived illumination pattern and a sequence of images to recover depth with an accuracy of 1 micron. Several experimental results are included to demonstrate the performances of both sensors. We conclude with a brief summary of our recent results on passive focus analysis.

[1]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[2]  S. Inokuchi,et al.  Range-imaging system for 3-D object recognition , 1984 .

[3]  K. L. Boyer,et al.  Color-EncodedStructured Light forRapid Active Ranging , 1987 .

[4]  Alex Pentland,et al.  Simple range cameras based on focal error , 1994 .

[5]  Shree K. Nayar,et al.  Microscopic shape from focus using active illumination , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[6]  Masahiro Watanabe,et al.  Telecentric Optics for Constant-Magnification Imaging , 1995 .

[7]  Alex Pentland,et al.  A New Sense for Depth of Field , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Shree K. Nayar,et al.  Real-time focus range sensor , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Peter Lawrence,et al.  A matrix based method for determining depth from focus , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  K. W. Cattermole The Fourier Transform and its Applications , 1965 .

[11]  Mats Gokstorp Computing depth from out-of-focus blur using a local frequency representation , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[12]  Rudolf Kingslake,et al.  Optical System Design , 1983 .

[13]  Ray A. Jarvis,et al.  A Perspective on Range Finding Techniques for Computer Vision , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Murali Subbarao Parallel Depth Recovery By Changing Camera Parameters , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[15]  Trevor Darrell,et al.  Pyramid based depth from focus , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Mats Gökstorp,et al.  Computing depth from out-of-focus blur using a local frequency representation , 1994, International Conference on Pattern Recognition.

[17]  Takeo Kanade,et al.  A VISI Smart Sensor For Fast Range Imaging , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Takeo Kanade,et al.  Development of a video-rate stereo machine , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[19]  E. H. Linfoot Principles of Optics , 1961 .

[20]  V. Bove Entropy-based depth from focus , 1993 .

[21]  Shree K. Nayar,et al.  Real-time computation of depth from defocus , 1996, Other Conferences.

[22]  Takeo Kanade,et al.  A very fast VLSI rangefinder , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[23]  H.N. Nair,et al.  Robust focus ranging , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Steven A. Shafer,et al.  Variable window Gabor filters and their use in focus and correspondence , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Eric Krotkov,et al.  Focusing , 2004, International Journal of Computer Vision.

[26]  Bernd Girod,et al.  Depth from Defocus of Structured Light , 1990, Other Conferences.

[27]  Shree K. Nayar,et al.  Shape from Focus , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  P. Grossmann,et al.  Depth from focus , 1987, Pattern Recognit. Lett..

[29]  Reg G. Willson Modeling and calibration of automated zoom lenses , 1994, Other Conferences.