Multi-View Reconstruction and Camera Recovery using a Real or Virtual Reference Plane

Reconstructing a 3-dimensional scene from a set of2-dimensional images is a fundamental problem in computervision. A system capable of performing this task can be used inmany applications in roboti ...

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Thomas S. Huang,et al.  Theory of Reconstruction from Image Motion , 1992 .

[3]  Stephen T. Barnard,et al.  Interpreting Perspective Image , 1983, Artif. Intell..

[4]  Carsten Rother,et al.  Linear Multi View Reconstruction and Camera Recovery Using a Reference Plane , 2002, International Journal of Computer Vision.

[5]  Gunnar Sparr,et al.  A Common Framework for Kinetic Depth, Reconstruction and Motion for Deformable Objects , 1994, ECCV.

[6]  P. Anandan,et al.  Factorization with Uncertainty , 2000, International Journal of Computer Vision.

[7]  Takeo Kanade,et al.  Shape and motion from image streams under orthography: a factorization method , 1992, International Journal of Computer Vision.

[8]  Andrew W. Fitzgibbon,et al.  Automatic Camera Recovery for Closed or Open Image Sequences , 1998, ECCV.

[9]  Yakup Genc,et al.  Fast algorithms for projective multi-frame structure from motion , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[11]  David Nistér,et al.  Reconstruction from Uncalibrated Sequences with a Hierarchy of Trifocal Tensors , 2000, ECCV.

[12]  Richard I. Hartley,et al.  Critical Curves and Surfaces for Euclidean Reconstruction , 2002, ECCV.

[13]  Paul A. Beardsley,et al.  Navigation using Affine Structure from Motion , 1994, ECCV.

[14]  Bill Triggs,et al.  Linear Projective Reconstruction from Matching Tensors , 1996, BMVC.

[15]  Daphna Weinshall,et al.  From Reference Frames to Reference Planes: Multi-View Parallax Geometry and Applications , 1998, ECCV.

[16]  O. Faugeras.  Stratification of three-dimensional vision: projective, affine, and metric representations , 1995 .

[17]  P. Anandan,et al.  About Direct Methods , 1999, Workshop on Vision Algorithms.

[18]  Roger Mohr,et al.  Epipole and fundamental matrix estimation using virtual parallax , 1995, Proceedings of IEEE International Conference on Computer Vision.

[19]  Dennis Tell,et al.  Wide baseline matching with applications to visual servoing , 2002 .

[20]  Gene H. Golub,et al.  Matrix computations , 1983 .

[21]  Ian D. Reid,et al.  Active tracking of foveated feature clusters using affine structure , 1996, International Journal of Computer Vision.

[22]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[23]  H. Barlow.  Vision Science: Photons to Phenomenology by Stephen E. Palmer , 2000, Trends in Cognitive Sciences.

[24]  J. G. Semple,et al.  Algebraic Projective Geometry , 1953 .

[25]  Reinhard Koch,et al.  Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[26]  Takeo Kanade,et al.  A unified factorization algorithm for points, line segments and planes with uncertainty models , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[27]  Richard I. Hartley,et al.  Critical configurations for n-view projective reconstruction , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[28]  Peter Meer,et al.  Balanced Recovery of 3D Structure and Camera Motion from Uncalibrated Image Sequences , 2002, ECCV.

[29]  Richard I. Hartley,et al.  In defence of the 8-point algorithm , 1995, Proceedings of IEEE International Conference on Computer Vision.

[30]  David Marr,et al.  VISION A Computational Investigation into the Human Representation and Processing of Visual Information , 2009 .

[31]  Daphna Weinshall,et al.  From Ordinal to Euclidean Reconstruction with Partial Scene Calibration , 1998, SMILE.

[32]  Luc Van Gool,et al.  The cascaded Hough transform as an aid in aerial image interpretation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[33]  Long Quan,et al.  Minimal projective reconstruction with missing data , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[34]  Stefan Carlsson,et al.  Duality of reconstruction and positioning from projective views , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[35]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.

[36]  Olivier D. Faugeras,et al.  On the geometry and algebra of the point and line correspondences between N images , 1995, Proceedings of IEEE International Conference on Computer Vision.

[37]  Harry Shum,et al.  A linear algorithm for camera self-calibration, motion and structure recovery for multi-planar scenes from two perspective images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[38]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[39]  Stefan Carlsson,et al.  Combining Appearance and Topology for Wide Baseline Matching , 2002, ECCV.

[40]  Long Quan,et al.  Invariants of 6 Points from 3 Uncalibrated Images , 1994, ECCV.

[41]  Robert Kaucic,et al.  Plane-based projective reconstruction , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[42]  Qian Chen,et al.  Efficient iterative solution to M-view projective reconstruction problem , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[43]  Richard Szeliski,et al.  Geometrically Constrained Structure from Motion: Points on Planes , 1998, SMILE.

[44]  Olivier Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[45]  David W. Murray,et al.  The tensors of three affine views , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[46]  Nassir Navab,et al.  Relative affine structure: theory and application to 3D reconstruction from perspective views , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[48]  Jan-Olof Eklundh,et al.  Object detection using model based prediction and motion parallax , 1990, ECCV.

[49]  Anders Heyden,et al.  Affine Structure and Motion from Points, Lines and Conics , 1999, International Journal of Computer Vision.

[50]  Roberto Cipolla,et al.  An Interactive System for Constraint-Based Modelling , 2000, British Machine Vision Conference.

[51]  M. Oskarsson,et al.  Classifying and solving minimal structure and motion problems with missing data , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[52]  Bill Triggs,et al.  Matching constraints and the joint image , 1995, Proceedings of IEEE International Conference on Computer Vision.

[53]  Amnon Shashua,et al.  Threading Fundamental Matrices , 1998, ECCV.

[54]  Carsten Rother,et al.  Linear Multi View Reconstruction with Missing Data , 2002, ECCV.

[55]  Anders Heyden,et al.  Algebraic Varieties in Multiple View Geometry , 1996, ECCV.

[56]  J. Oliensis,et al.  Multiframe structure from motion in perspective , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[57]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[58]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[59]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[60]  Lihi Zelnik-Manor,et al.  Multi-view subspace constraints on homographies , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[61]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[62]  P. Anandan,et al.  Direct Recovery of Planar-Parallax from Multiple Frames , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[63]  E. Boring.  The perception of the visual world. , 1951 .

[64]  Bill Triggs,et al.  Plane+Parallax, Tensors and Factorization , 2000, ECCV.

[65]  Stephen J. Maybank,et al.  A Method for Interactive 3D Reconstruction of Piecewise Planar Objects from Single Images , 1999, BMVC.

[66]  Wei Zhang,et al.  Video Compass , 2002, ECCV.

[67]  Alan L. Yuille,et al.  Manhattan World: compass direction from a single image by Bayesian inference , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[68]  Andrew W. Fitzgibbon,et al.  Parallax geometry of smooth surfaces in multiple views , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[69]  Richard I. Hartley,et al.  Dualizing Scene Reconstruction Algorithms , 1998, SMILE.

[70]  Cordelia Schmid,et al.  The Geometry and Matching of Lines and Curves Over Multiple Views , 2000, International Journal of Computer Vision.

[71]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[72]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[73]  Stefan Carlsson,et al.  Calibration, pose and novel views from single images of constrained scenes , 2000, Pattern Recognit. Lett..

[74]  Takeo Kanade,et al.  A Paraperspective Factorization Method for Shape and Motion Recovery , 1994, ECCV.

[75]  Björn Johansson.  View synthesis and 3D reconstruction of piecewise planar scenes using intersection lines between the planes , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[76]  Tomás Pajdla,et al.  Structure from Many Perspective Images with Occlusions , 2002, ECCV.

[77]  David Liebowitz,et al.  Camera Calibration and Reconstruction of Geometry from Images , 2001 .

[78]  Amnon Shashua,et al.  Trilinearity in Visual Recognition by Alignment , 1994, ECCV.

[79]  David Nistér,et al.  Frame Decimation for Structure and Motion , 2000, SMILE.

[80]  Marco Zucchelli.  Optical Flow Based Structure from Motion , 2002 .

[81]  Beatrice Brillault-O'Mahony,et al.  New method for vanishing point detection , 1991, CVGIP Image Underst..

[82]  Carsten Rother,et al.  Linear Multi View Reconstruction and Camera Recovery , 2001, ICCV.

[83]  David Nister,et al.  Automatic Dense Reconstruction from Uncalibrated Video Sequences , 2001 .

[84]  Anders Heyden,et al.  Direct affine reconstruction , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[85]  Gunnar Sparr,et al.  Simultaneous reconstruction of scene structure and camera locations from uncalibrated image sequences , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[86]  Andrew Zisserman,et al.  Combining scene and auto-calibration constraints , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[87]  Peter F. Sturm,et al.  Algorithms for plane-based pose estimation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[88]  F. A. Heuvel.  VANISHING POINT DETECTION FOR ARCHITECTURAL PHOTOGRAMMETRY , 1998 .

[89]  A. Heyden,et al.  A canonical framework for sequences of images , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[90]  Andrew Zisserman,et al.  Automatic reconstruction of piecewise planar models from multiple views , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[91]  J. Gibson.  The perception of the visual world , 1951 .

[92]  Carsten Rother.  A new approach to vanishing point detection in architectural environments , 2002, Image Vis. Comput..

[93]  Bill Triggs,et al.  Autocalibration and the absolute quadric , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[94]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[95]  Bernard Mourrain,et al.  Using scene constraints during the calibration procedure , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[96]  Anders Heyden,et al.  An iterative factorization method for projective structure and motion from image sequences , 1999, Image Vis. Comput..

[97]  Geoff A. W. West,et al.  Segmentation of edges into lines and arcs , 1989, Image Vis. Comput..

[98]  Luc Van Gool,et al.  Surviving Dominant Planes in Uncalibrated Structure and Motion Recovery , 2002, ECCV.

[99]  Roberto Cipolla,et al.  Building Architectural Models from Many Views Using Map Constraints , 2002, ECCV.

[100]  Daphna Weinshall,et al.  Dual Computation of Projective Shape and Camera Positions from Multiple Images , 1998, International Journal of Computer Vision.

[101]  Harpreet S. Sawhney,et al.  3D geometry from planar parallax , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[102]  Tal Hassner,et al.  What Does the Scene Look Like from a Scene Point? , 2002, ECCV.

[103]  P. Anandan,et al.  Direct recovery of shape from multiple views: a parallax based approach , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[104]  Mei Han,et al.  Interactive construction of 3D models from panoramic mosaics , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[105]  Carsten Rother,et al.  Projective factorization of planes and cameras in multiple views , 2002, Object recognition supported by user interaction for service robots.

[106]  Takeo Kanade,et al.  Affine structure from line correspondences with uncalibrated affine cameras , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[107]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[108]  Richard I. Hartley.  Ambiguous Configurations for 3-View Projective Reconstruction , 2000, ECCV.

[109]  M. Isard,et al.  Automatic Camera Calibration from a Single Manhattan Image , 2002, ECCV.

[110]  Roger MohrLifia.  Epipole and Fundamental Matrix Estimation Using the Virtual Parallax Property , 1995 .

[111]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[112]  Peter F. Sturm,et al.  A Factorization Based Algorithm for Multi-Image Projective Structure and Motion , 1996, ECCV.

[113]  Anders Heyden,et al.  Simplifications of multilinear forms for sequences of images , 1997, Image Vis. Comput..

[114]  Andrew Zisserman,et al.  A Six Point Solution for Structure and Motion , 2000, ECCV.

[115]  Seth J. Teller,et al.  Scalable Extrinsic Calibration of Omni-Directional Image Networks , 2002, International Journal of Computer Vision.

[116]  David W. Jacobs,et al.  Linear Fitting with Missing Data for Structure-from-Motion , 2001, Comput. Vis. Image Underst..

[117]  Amnon Shashua,et al.  The Rank 4 Constraint in Multiple (>=3) View Geometry , 1996, ECCV.

[118]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[119]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[120]  O. D. Faugeras,et al.  Camera Self-Calibration: Theory and Experiments , 1992, ECCV.

[121]  Andrew Zisserman,et al.  Robust parameterization and computation of the trifocal tensor , 1997, Image Vis. Comput..

[122]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[123]  P. Anandan,et al.  Parallax Geometry of Pairs of Points for 3D Scene Analysis , 1996, ECCV.

[124]  Philip H. S. Torr,et al.  The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix , 1997, International Journal of Computer Vision.

[125]  Alan D. Jones.  Manual of Photogrammetry, eds C.C. Slama, C. Theurer and S.W. Hendrikson, American Society of Photogrammetry, Falls Church, Va., 1980, Fourth Edition, 180 × 260mm, xvi and 1056 pages (with index), 72 tables, 866 figures. ISBN 0 937294 01 2. , 1982 .

[126]  Carsten Rother,et al.  A New Approach for Vanishing Point Detection in Architectural Environments , 2000, BMVC.

[127]  Lars Bretzner,et al.  Use Your Hand as a 3-D Mouse, or, Relative Orientation from Extended Sequences of Sparse Point and Line Correspondences Using the Affine Trifocal Tensor , 1998, ECCV.

[128]  Michal Irani,et al.  Representation of scenes from collections of images , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[129]  Bill Triggs,et al.  Factorization methods for projective structure and motion , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[130]  Long Quan,et al.  Determining perspective structures using hierarchical Hough transform , 1989, Pattern Recognit. Lett..

[131]  C. E. Springer,et al.  Geometry and Analysis of Projective Spaces , 1967 .

[132]  John Oliensis,et al.  A Multi-Frame Structure-from-Motion Algorithm under Perspective Projection , 1999, International Journal of Computer Vision.

[133]  Ian D. Reid,et al.  Duality, Rigidity and Planar Parallax , 1998, ECCV.

[134]  Richard I. Hartley,et al.  Projective reconstruction from line correspondences , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[135]  William H. Press,et al.  Numerical recipes in C , 2002 .

[136]  Luc Van Gool,et al.  Affine Reconstruction from Perspective Image Pairs Obtained by a Translating Camera , 1993, Applications of Invariance in Computer Vision.

[137]  Thierry Viéville,et al.  Canonical Representations for the Geometries of Multiple Projective Views , 1996, Comput. Vis. Image Underst..

[138]  Radu Horaud,et al.  Projective Structure and Motion from Two Views of a Piecewise Planar Scene , 2001, ICCV.

[139]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.