Single view metrology

We describe how 3D affine measurements may be computed from a single perspective view of a scene given only minimal geometric information determined from the image. This minimal information is typically the vanishing line of a reference plane and a vanishing point for a direction not parallel to the plane. It is shown that affine scene structure may then be determined from the image, without knowledge of the camera's internal calibration (e.g. focal length), nor of the explicit relation between camera and world (pose). In particular we show how to: compute the distance between planes parallel to the reference plane (up to a common scale factor); compute area and length ratios on any plane parallel to the reference plane; determine the camera's (viewer's) location. Simple geometric derivations are given for these results. We also develop an algebraic representation which unifies the three types of measurement and, amongst other advantages, permits a first order error propagation analysis to be performed, associating an uncertainty with each measurement. We demonstrate the technique for a variety of applications, including height measurements in forensic images and 3D graphical modelling from single images.

[1]  C. E. Springer,et al.  Geometry and Analysis of Projective Spaces , 1967 .

[2]  J. H. Wilkinson The algebraic eigenvalue problem , 1966 .

[3]  Stephen T. Barnard,et al.  Interpreting Perspective Image , 1983, Artif. Intell..

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Robert T. Collins,et al.  Vanishing point calculation as a statistical inference on the unit sphere , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[7]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[8]  J J Koenderink,et al.  Affine structure from motion. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[9]  Olivier D. Faugeras,et al.  Relative 3D positioning and 3D convex hull computation from a weakly calibrated stereo pair , 1993, 1993 (4th) International Conference on Computer Vision.

[10]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[11]  Olivier Faugeras,et al.  Automatic calibration and removal of distortion from scenes of structured environments , 1995, Optics & Photonics.

[12]  M. Brady,et al.  Rejecting outliers and estimating errors in an orthogonal-regression framework , 1995, Philosophical Transactions of the Royal Society of London. Series A: Physical and Engineering Sciences.

[13]  G. F. McLean,et al.  Vanishing Point Detection by Line Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Ian D. Reid,et al.  Goal-directed Video Metrology , 1996, ECCV.

[15]  Ken-ichi Anjyo,et al.  Tour into the picture: using a spidery mesh interface to make animation from a single image , 1997, SIGGRAPH.

[16]  Yongduek Seo,et al.  Physics-based 3D position analysis of a soccer ball from monocular image sequences , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[17]  Luc Van Gool,et al.  Planar homologies as a basis for grouping and recognition , 1998, Image Vis. Comput..

[18]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[19]  Ian D. Reid,et al.  3D Trajectories from a Single Viewpoint using Shadows , 1998, BMVC.

[20]  Stephen J. Maybank,et al.  A Method for Interactive 3D Reconstruction of Piecewise Planar Objects from Single Images , 1999, BMVC.

[21]  Jefferey A. Shufelt,et al.  Performance Evaluation and Analysis of Vanishing Point Detection Techniques , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Ian D. Reid,et al.  A plane measuring device , 1999, Image Vis. Comput..

[23]  Antonio Criminisi,et al.  Creating Architectural Models from Images , 1999, Comput. Graph. Forum.