Piecewise planar scene reconstruction from sparse correspondences

A novel method able to recover scene planes of arbitrary position and orientation from oriented images using homographies is presented. Planar regions are reconstructed using only sparse, affine-invariant sets of corresponding seed regions. These regions are iteratively expanded and refined using plane-induced homographies. Experiments on synthetic data show the high accuracy of the reconstruction and demonstrate that the reconstruction method can cope with large baseline changes. Experiments on real images show the performance of the method on practically relevant scenes.

[1]  Thierry Viéville,et al.  Canonical Representations for the Geometries of Multiple Projective Views , 1996, Comput. Vis. Image Underst..

[2]  Ian D. Reid,et al.  A plane measuring device , 1999, Image Vis. Comput..

[3]  Manolis I. A. Lourakis,et al.  Matching disparate views of planar surfaces using projective invariants , 2000, Image Vis. Comput..

[4]  Cordelia Schmid,et al.  AUTOMATIC LINE MATCHING AND 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE VIEWS , 1999 .

[5]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[6]  Luc Van Gool,et al.  Edinburgh Research Explorer Simultaneous Object Recognition and Segmentation by Image Exploration , 2022 .

[7]  Horst Bischof,et al.  Detecting Distinguished Regions by Saliency , 2003, SCIA.

[8]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[9]  Carsten Rother,et al.  Linear Multi View Reconstruction and Camera Recovery , 2001, ICCV.

[10]  Dmitry B. Goldgof,et al.  The Space Envelope: A Representation for 3D Scenes , 1998, Comput. Vis. Image Underst..

[11]  Dani Lischinski,et al.  Compression of indoor video sequences using homography-based segmentation , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[12]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[13]  Andrew Zisserman,et al.  Wide baseline stereo matching , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[14]  Roger Mohr,et al.  Direct linear sub-pixel correlation by incorporation of neighbor pixels' information and robust estimation of window transformation , 1998, Machine Vision and Applications.

[15]  Konrad Schindler.  Generalized Use of Homographies for Piecewise Planar Reconstruction , 2003, SCIA.

[16]  Herbert Freeman.  Machine Vision: Algorithms, Architectures, and Systems , 1988 .

[17]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[18]  Rakesh Kumar,et al.  Shape Recovery from Multiple Views: A Parallax Based Approach , 1994 .

[19]  Konrad Schindler,et al.  Plane parameter estimation by edge set matching , 2002 .

[20]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[21]  David Capel,et al.  Image Mosaicing and Super-resolution , 2004, Distinguished Dissertations.

[22]  Richard Szeliski,et al.  Geometrically Constrained Structure from Motion: Points on Planes , 1998, SMILE.

[23]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[24]  Daphna Weinshall,et al.  From Reference Frames to Reference Planes: Multi-View Parallax Geometry and Applications , 1998, ECCV.

[25]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[26]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[27]  Andrew Zisserman,et al.  A PLANE-SWEEP STRATEGY FOR THE 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE IMAGES , 2000 .

[28]  Richard I. Hartley,et al.  Plane-based Projective Reconstruction , 2001, ICCV.

[29]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[30]  Paul J. Besl,et al.  Range image segmentation , 1988 .

[31]  Takeo Kanade,et al.  A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Manolis I. A. Lourakis,et al.  Feature Transfer and Matching in Disparate Stereo Views through the Use of Plane Homographies , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.