Surface reconstruction from multiple views using rational B-splines and knot insertion

A method for reconstructing 3D rational B-spline surfaces from multiple views is proposed. Given corresponding features in multiple views, though not necessarily visible in all views, the surface is reconstructed. First 2D B-spline patches are fitted to each view. The 3D B-spline and projection matrices can then be extracted from the 2D B-splines using factorization methods. The surface fit is then further refined via an iterative procedure. Finally, a hierarchal fitting scheme is proposed to allow modeling of complex surfaces by means of knot insertion. Experiments with real imagery demonstrate the efficacy of the approach.

[1]  Olivier Faugeras,et al.  Motion and Structure from Motion in a piecewise Planar Environment , 1988, Int. J. Pattern Recognit. Artif. Intell..

[2]  Jean-Christophe Lombardo,et al.  Oriented particles: A tool for shape memory objects modelling , 1995 .

[3]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[4]  Richard Szeliski,et al.  Surface modeling with oriented particle systems , 1992, SIGGRAPH.

[5]  Richard Szeliski,et al.  Motion Estimation with Quadtree Splines , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Zicheng Liu,et al.  Model-based bundle adjustment with application to face modeling , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Pascal Fua,et al.  Taking Advantage of Image-Based and Geometry-Based Constraints to Recover 3-D Surfaces , 1996, Comput. Vis. Image Underst..

[8]  Stan Sclaroff,et al.  Recursive estimation of motion and planar structure , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[11]  Andrew Zisserman,et al.  Quadric Surface Reconstruction from Dual-Space Geometry. , 1998, ICCV 1998.

[12]  Andrew Blake,et al.  Quantitative planar region detection , 2004, International Journal of Computer Vision.

[13]  Matthias Eck,et al.  Automatic reconstruction of B-spline surfaces of arbitrary topological type , 1996, SIGGRAPH.

[14]  Larry H. Matthies,et al.  Kalman filter-based algorithms for estimating depth from image sequences , 1989, International Journal of Computer Vision.

[15]  Michael Isard,et al.  Active Contours: The Application of Techniques from Graphics, Vision, Control Theory and Statistics to Visual Tracking of Shapes in Motion , 2000 .

[16]  Michael A. Malcolm,et al.  Computer methods for mathematical computations , 1977 .

[17]  ShashuaAmnon,et al.  The Quadric Reference Surface , 1997 .

[18]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[19]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Tat-Jen Cham,et al.  Stereo coupled active contours , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Narendra Ahuja,et al.  Motion and structure from point correspondences: a robust algorithm for planar case with error estimation , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[22]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[23]  Richard Szeliski,et al.  Geometrically Constrained Structure from Motion: Points on Planes , 1998, SMILE.

[24]  Andrew Zisserman,et al.  Automatic reconstruction of piecewise planar models from multiple views , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[25]  N. Ahuja,et al.  Segmentation, matching and estimation of structure and motion of textured piecewise planar surfaces , 1991, Proceedings of the IEEE Workshop on Visual Motion.

[26]  Pascal Fua,et al.  From Multiple Stereo Views to Multiple 3-D Surfaces , 1997, International Journal of Computer Vision.

[27]  Gerald Farin,et al.  NURBS: From Projective Geometry to Practical Use , 1999 .

[28]  Houda Chabbi Drissi,et al.  Facet Matching from an Uncalibrated Pair of Images , 1998, MVA.

[29]  R. Chellappa,et al.  Recursive 3-D motion estimation from a monocular image sequence , 1990 .

[30]  William H. Press,et al.  Numerical recipes in C , 2002 .

[31]  P. Perona,et al.  Recursive 3-D Visual Motion Estimation Using Subspace Constraints , 1997, International Journal of Computer Vision.

[32]  Amnon Shashua,et al.  The Quadric Reference Surface: Theory and Applications , 2004, International Journal of Computer Vision.

[33]  Richard Szeliski,et al.  Hierarchical spline-based image registration , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.