Spectral Solution of Large-Scale Extrinsic Camera Calibration as a Graph Embedding Problem

Extrinsic calibration of large-scale ad hoc networks of cameras is posed as the following problem: Calculate the locations of N mobile, rotationally aligned cameras distributed over an urban region, subsets of which view some common environmental features. We show that this leads to a novel class of graph embedding problems that admit closed-form solutions in linear time via partial spectral decomposition of a quadratic form. The minimum squared error (mse) solution determines locations of cameras and/or features in any number of dimensions. The spectrum also indicates insufficiently constrained problems, which can be decomposed into well-constrained rigid subproblems and analyzed to determine useful new views for missing constraints. We demonstrate the method with large networks of mobile cameras distributed over an urban environment, using directional constraints that have been extracted automatically from commonly viewed features. Spectral solutions yield layouts that are consistent in some cases to a fraction of a millimeter, substantially improving the state of the art. Global layout of large camera networks can be computed in a fraction of a second.

[1]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[2]  V. Michael Bove,et al.  Semiautomatic 3-D model extraction from uncalibrated 2-D camera views , 1995 .

[3]  W. T. Tutte How to Draw a Graph , 1963 .

[4]  Quang-Tuan Luong,et al.  Self-Calibration of a Moving Camera from Point Correspondences and Fundamental Matrices , 1997, International Journal of Computer Vision.

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[7]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[8]  Olivier D. Faugeras,et al.  Camera Calibration, Scene Motion and Structure recovery from point correspondences and fundamental m , 1997 .

[9]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[10]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[11]  John C. H. Leung,et al.  Vanishing point matching , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[12]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Takeo Kanade,et al.  A Paraperspective Factorization Method for Shape and Motion Recovery , 1994, ECCV.

[14]  Shigang Li,et al.  Determining of camera rotation from vanishing points of lines on horizontal planes , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[15]  Ehud Rivlin,et al.  ROR: rejection of outliers by rotations in stereo matching , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[16]  Jan-Olof Eklundh,et al.  Computer Vision — ECCV '94 , 1994, Lecture Notes in Computer Science.

[17]  W. T. Tutte Convex Representations of Graphs , 1960 .

[18]  V. Bove,et al.  Semiautomatic 3D-model extraction from uncalibrated 2D-camera views , 1995 .

[19]  Seth J. Teller,et al.  Scalable Extrinsic Calibration of Omni-Directional Image Networks , 2002, International Journal of Computer Vision.