Affine Reconstruction of Curved Surfaces from Uncalibrated Views of Apparent Contours

In this paper, we consider uncalibrated reconstruction of curved surfaces from apparent contours. Since apparent contours are not fixed features (viewpoint independent), we cannot directly apply the recent results of the uncalibrated reconstruction from fixed features. We show that, nonetheless, curved surfaces can be reconstructed up to an affine ambiguity from their apparent contours viewed from uncalibrated cameras with unknown linear translations. Furthermore, we show that, even if the reconstruction is nonmetric (non-Euclidean), we can still extract useful information for many computer vision applications just from the apparent contours. We first show that if the camera motion is linear translation (but arbitrary direction and magnitude), the epipolar geometry can be recovered from the apparent contours without using any optimization process. The extracted epipolar geometry is next used for reconstructing curved surfaces from the deformations of the apparent contours viewed from uncalibrated cameras. The result is applied to distinguishing curved surfaces from fixed features in images. It is also shown that the time-to-contact to the curved surfaces can be computed from simple measurements of the apparent contours.

[1]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[2]  Joseph L. Mundy,et al.  Repeated Structures: Image Correspondence Constraints and 3D Structure Recovery , 1993, Applications of Invariance in Computer Vision.

[3]  Kiriakos N. Kutulakos,et al.  Global surface reconstruction by purposive control of observer motion , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  J. H. Rieger Three-dimensional motion from fixed points of a deforming profile curve. , 1986, Optics letters.

[6]  John Porrill,et al.  Curve matching and stereo calibration , 1991, Image and Vision Computing.

[7]  Luc Van Gool,et al.  Affine reconstruction from perspective image pairs obtained by a translating camera , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[8]  Kiriakos N. Kutulakos Affine surface reconstruction by purposive viewpoint control , 1995, Proceedings of IEEE International Conference on Computer Vision.

[9]  Olivier D. Faugeras,et al.  Using Extremal Boundaries for 3-D Object Modeling , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  David J. Kriegman,et al.  Invariant-based recognition of complex curved 3D objects from image contours , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  Luc Van Gool,et al.  Eliciting qualitative structure from image curve deformations , 1993, 1993 (4th) International Conference on Computer Vision.

[12]  Edmond Boyer,et al.  Object Models from Contour Sequences , 1996, ECCV.

[13]  Roberto Cipolla,et al.  Motion from the frontier of curved surfaces , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  Kiriakos N. Kutulakos Shape from the light field boundary , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Richard S. Weiss,et al.  Reconstruction of Surfaces from Profiles , 1987, ICCV 1987.

[16]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[17]  Peter J. Giblin,et al.  Epipolar Fields on Surfaces , 1994, ECCV.

[18]  Tat-Jen Cham,et al.  Automated B-Spline Curve Representation with MDL-based Active Contours , 1996, BMVC.

[19]  Roger Mohr,et al.  Global Three-Dimensional Surface Reconstruction from Occluding Contours , 1996, Comput. Vis. Image Underst..

[20]  Andrew Blake,et al.  Surface Orientation and Time to Contact from Image Divergence and Deformation , 1992, ECCV.

[21]  Roberto Cipolla,et al.  Generalised Epipolar Constraints , 1996, ECCV.

[22]  Narendra Ahuja,et al.  Structure and Motion Estimation from Dynamic Silhouettes under Perspective Projection , 1995, Proceedings of IEEE International Conference on Computer Vision.

[23]  Olivier D. Faugeras,et al.  Building Three-Dimensional Object Models from Image Sequences , 1995, Comput. Vis. Image Underst..

[24]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[25]  Kiriakos N. Kutulakos,et al.  Occluding contour detection using affine invariants and purposive viewpoint control , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[26]  David J. Kriegman,et al.  Invariant-Based Recognition of Complex Curved 3D Objects from Image Contours , 1998, Comput. Vis. Image Underst..

[27]  Andrew W. Fitzgibbon,et al.  Convex hulls, occluding contours, aspect graphs and the Hough transform , 1996, Image Vis. Comput..