Gauge fixing for accurate 3D estimation

Computer vision techniques can estimate 3D shape from images, but usually only up to a scale factor. The scale factor must be obtained by a physical measurement of the scene or the camera motion. Using gauge theory, we show that how this scale factor is determined can significantly affect the accuracy of the estimated shape. And yet these considerations have been ignored in previous works where 3D shape accuracy is optimized. We investigate how scale fixing influences the accuracy of 3D reconstruction and determine what measurement should be made to maximize the shape accuracy.

[1]  P. Teunissen.  Zero Order Design: Generalized Inverses, Adjustment, the Datum Problem and S-Transformations , 1985 .

[2]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[3]  Kenichi Kanatani,et al.  Gauges and gauge transformations for uncertainty description of geometric structure with indeterminacy , 2001, IEEE Trans. Inf. Theory.

[4]  Kenichi Kanatani,et al.  Statistical optimization for geometric computation - theory and practice , 1996, Machine intelligence and pattern recognition.

[5]  Takeo Kanade,et al.  Uncertainty Modeling for Optimal Structure from Motion , 1999, Workshop on Vision Algorithms.

[6]  K. Atkinson.  Close Range Photogrammetry and Machine Vision , 1996 .

[7]  Allen Hanson,et al.  Refining 3D reconstruction: a theoretical and experimental study of the effect of cross-correlations , 1994 .

[8]  Narendra Ahuja,et al.  Optimal motion and structure estimation , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Robert M. Haralick,et al.  Propagating covariance in computer vision , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[10]  Kenichi Kanatani,et al.  Gauges and Gauge Transformations in 3-D Reconstruction from a Sequence of Images , 2000 .

[11]  Takeo Kanade,et al.  A unified factorization algorithm for points, line segments and planes with uncertainty models , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Robert M. Haralick.  Propagating Covariance in Computer Vision , 1996, Int. J. Pattern Recognit. Artif. Intell..

[13]  Richard Szeliski,et al.  Shape Ambiguities in Structure From Motion , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Philip F. McLauchlan,et al.  Gauge Independence in Optimization Algorithms for 3D Vision , 1999, Workshop on Vision Algorithms.

[15]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.