Single View Metrology

We describe how 3D affine measurements may be computed from a single perspective view of a scene given only minimal geometric information determined from the image. This minimal information is typically the vanishing line of a reference plane, and a vanishing point for a direction not parallel to the plane. It is shown that affine scene structure may then be determined from the image, without knowledge of the camera's internal calibration (e.g. focal length), nor of the explicit relation between camera and world (pose).In particular, we show how to (i) compute the distance between planes parallel to the reference plane (up to a common scale factor); (ii) compute area and length ratios on any plane parallel to the reference plane; (iii) determine the camera's location. Simple geometric derivations are given for these results. We also develop an algebraic representation which unifies the three types of measurement and, amongst other advantages, permits a first order error propagation analysis to be performed, associating an uncertainty with each measurement.We demonstrate the technique for a variety of applications, including height measurements in forensic images and 3D graphical modelling from single images.

[1]  C. E. Springer,et al.  Geometry and Analysis of Projective Spaces , 1967 .

[2]  J. H. Wilkinson The algebraic eigenvalue problem , 1966 .

[3]  Stephen T. Barnard,et al.  Interpreting Perspective Image , 1983, Artif. Intell..

[4]  Gene H. Golub,et al.  Matrix computations , 1983 .

[5]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Robert T. Collins,et al.  Vanishing point calculation as a statistical inference on the unit sphere , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[8]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[9]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[10]  Olivier D. Faugeras,et al.  Relative 3D positioning and 3D convex hull computation from a weakly calibrated stereo pair , 1993, 1993 (4th) International Conference on Computer Vision.

[11]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[12]  Olivier Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[13]  M. Brady,et al.  Rejecting outliers and estimating errors in an orthogonal-regression framework , 1995, Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences.

[14]  G. F. McLean,et al.  Vanishing Point Detection by Line Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Ian D. Reid,et al.  Goal-directed Video Metrology , 1996, ECCV.

[16]  Ken-ichi Anjyo,et al.  Tour into the picture: using a spidery mesh interface to make animation from a single image , 1997, SIGGRAPH.

[17]  Yongduek Seo,et al.  Physics-based 3D position analysis of a soccer ball from monocular image sequences , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[18]  Luc Van Gool,et al.  Planar homologies as a basis for grouping and recognition , 1998, Image Vis. Comput..

[19]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[20]  J. Clarke Modelling uncertainty: A primer , 1998 .

[21]  Ian D. Reid,et al.  3D Trajectories from a Single Viewpoint using Shadows , 1998, BMVC.

[22]  I. Reid,et al.  Single view metrology , 1999, ICCV 1999.

[23]  Stephen J. Maybank,et al.  A Method for Interactive 3D Reconstruction of Piecewise Planar Objects from Single Images , 1999, BMVC.

[24]  Jefferey A. Shufelt,et al.  Performance Evaluation and Analysis of Vanishing Point Detection Techniques , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Ian D. Reid,et al.  A plane measuring device , 1999, Image Vis. Comput..

[26]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.

[27]  P. Sturm A method for 3D reconstruction of piecewise planar objects from single panoramic images , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[28]  Antonio Criminisi,et al.  Bringing Pictorial Space to Life: computer techniques for the analysis of paintings , 2002 .

[29]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[30]  Long Quan,et al.  Affine shape representation from motion through reference points , 2004, Journal of Mathematical Imaging and Vision.

[31]  Thierry Viéville,et al.  Using Specific Displacements to Analyze Motion without Calibration , 1999, International Journal of Computer Vision.