Shape Reconstruction and Camera Self-Calibration Using Cast Shadows and Scene Geometries

Recently, various techniques of shape reconstruction using cast shadows have been proposed. These techniques have the advantage that they can be applied to various scenes, including outdoor scenes, without using special devices. Previously proposed techniques usually require calibration of camera parameters and light source positions, and such calibration processes limit the range of application of these techniques. In this paper, we propose a method to reconstruct 3D scenes even when the camera parameters or light source positions are unknown. The technique first recovers the shape with 4-DOF indeterminacy using coplanarities obtained by cast shadows of straight edges or visible planes in a scene, and then upgrades the shape using metric constraints obtained from the geometrical constraints in the scene. In order to circumvent the need for calibrations and special devices, we propose both linear and nonlinear methods in this paper. Experiments using simulated and real images verified the effectiveness of this technique.

[1]  Ryo Furukawa,et al.  Dense 3D Reconstruction method using Coplanarities and Metric Constraints for Line Laser Scanning , 2007, Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007).

[2]  K. Sato,et al.  Range imaging system utilizing nematic liquid crystal mask , 1987 .

[3]  Pietro Perona,et al.  What do planar shadows tell about scene geometry? , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[4]  Pietro Perona,et al.  3D photography on your desk , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Murray H. Loew,et al.  The Entry-Exit Method of Shadow Boundary Segmentation , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  John R. Kender,et al.  An optimal algorithm for the derivation of shape from shadows , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  David J. Kriegman,et al.  What Shadows Reveal about Object Structure , 1998, ECCV.

[8]  Pietro Perona,et al.  3D Reconstruction by Shadow Carving: Theory and Practical Evaluation , 2007, International Journal of Computer Vision.

[9]  K. Sugihara.  Machine interpretation of line drawings , 1986, MIT Press series in artificial intelligence.

[10]  Takeo Kanade,et al.  Using shadows in finding surface orientations , 1983, Comput. Vis. Graph. Image Process..

[11]  Claire-Lise Mottaz Jiang,et al.  Shadow segmentation and classification in a constrained environment , 1994 .

[12]  David J. Kriegman,et al.  What shadows reveal about object structure. , 2001 .

[13]  Takeo Kanade,et al.  Coplanar Shadowgrams for Acquiring Visual Hulls of Intricate Objects , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[14]  Yizhou Yu,et al.  Shadow Graphs and 3D Texture Reconstruction , 2005, Int. J. Comput. Vis..

[15]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[16]  Kenneth A. Loparo,et al.  Reconstruction of three-dimensional surfaces from two-dimensional binary images , 1989, IEEE Trans. Robotics Autom..

[17]  Gregory Dudek,et al.  On 3-D surface reconstruction using shape from shadows , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[18]  Adrien Bartoli,et al.  Constrained Structure and Motion From Multiple Uncalibrated Views of a Piecewise Planar Scene , 2003, International Journal of Computer Vision.

[19]  Michael Werman,et al.  Vertical Parallax from Moving Shadows , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[20]  Ian D. Reid,et al.  Single View Metrology , 2000, International Journal of Computer Vision.