Shape from depth discontinuities under orthographic projection

We present a new method for reconstructing the 3-D surface of an opaque object from the motion of its depth discontinuities, when viewed under orthographic projection as the object undergoes rigid rotation on a turntable. A novel shape completion scheme is introduced to fill in gaps in the recovered surface, which would otherwise be impossible to reconstruct from the motion of the depth discontinuities alone. To verify the basic theory, we construct a large-format orthographic multi-flash camera capable of recovering the depth discontinuities using controlled illumination. We analyze the limitations of multi-flash depth edge detection using orthographic imaging with both point sources and directional illumination. We conclude by considering future applications for the shape completion scheme and the specialized hardware introduced in this work.

[1]  Douglas Lanman,et al.  Beyond Silhouettes: Surface Reconstruction Using Multi-Flash Photography , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[2]  Robert C. Bolles,et al.  Epipolar-plane image analysis: An approach to determining structure from motion , 1987, International Journal of Computer Vision.

[3]  Benjamin B. Kimia,et al.  Euler Spiral for Shape Completion , 2003, International Journal of Computer Vision.

[4]  Steve Marschner,et al.  Filling holes in complex surfaces using volumetric diffusion , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[5]  François Blais.  Review of 20 years of range sensor development , 2004, J. Electronic Imaging.

[6]  Andrew W. Fitzgibbon,et al.  Learning spatiotemporal T-junctions for occlusion detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[8]  Ramesh Raskar,et al.  Non-photorealistic camera: depth edge detection and stylized rendering using multi-flash imaging , 2004 .

[9]  Leonidas J. Guibas,et al.  Discovering structural regularity in 3D geometry , 2008, ACM Trans. Graph..

[10]  Peter Eisert,et al.  Extension of epipolar image analysis to circular camera movements , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[11]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[12]  P. Sturm,et al.  On Calibration, Structure from Motion and Multi-View Geometry for Generic Camera Models , 2006 .

[13]  Shree K. Nayar,et al.  Telecentric Optics for Computational Vision , 1996, ECCV.

[14]  Matthias Zwicker,et al.  Pointshop 3D: an interactive system for point-based surface editing , 2002, SIGGRAPH.

[15]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[16]  Stephen Lin,et al.  Multiple-cue illumination estimation in textured scenes , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Eero P. Simoncelli,et al.  Steerable wedge filters for local orientation analysis , 1996, IEEE Trans. Image Process..

[19]  S. Ullman,et al.  Filling-in the gaps: The shape of subjective contours and a model for their generation , 1976, Biological Cybernetics.

[20]  Berthold K. P. Horn.  The Curve of Least Energy , 1983, TOMS.

[21]  Pier Luigi Dragotti,et al.  Segmentation of Epipolar-Plane Image Volumes with Occlusion and Disocclusion Competition , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[22]  Lyndon Smith,et al.  Overview of passive and active vision techniques for hand-held 3D data acquistion , 2003, SPIE OPTO-Ireland.

[23]  Robert C. Bolles,et al.  Generalizing Epipolar-Plane Image Analysis on the spatiotemporal surface , 2004, International Journal of Computer Vision.

[24]  R. E. Carlson,et al.  Monotone Piecewise Cubic Interpolation , 1980 .

[25]  Roberto Cipolla,et al.  The visual motion of curves and surfaces , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[26]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[27]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Achim Schweikard.  Real zero isolation for trigonometric polynomials , 1992, TOMS.

[29]  Guillermo Sapiro,et al.  Inpainting surface holes , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).