Rotation Averaging

This paper is conceived as a tutorial on rotation averaging, summarizing the research that has been carried out in this area; it discusses methods for single-view and multiple-view rotation averaging, as well as providing proofs of convergence and convexity in many cases. However, at the same time it contains many new results, which were developed to fill gaps in knowledge, answering fundamental questions such as radius of convergence of the algorithms, and existence of local minima. These matters, or even proofs of correctness have in many cases not been considered in the Computer Vision literature. We consider three main problems: single rotation averaging, in which a single rotation is computed starting from several measurements; multiple-rotation averaging, in which absolute orientations are computed from several relative orientation measurements; and conjugate rotation averaging, which relates a pair of coordinate frames. This last is related to the hand-eye coordination problem and to multiple-camera calibration.

[1]  Kostas Daniilidis,et al.  Hand-Eye Calibration Using Dual Quaternions , 1999, Int. J. Robotics Res..

[2]  Lawrence M. Ostresh.  On the Convergence of a Class of Iterative Methods for Solving the Weber Location Problem , 1978, Oper. Res..

[3]  Arian Maleki,et al.  Geodesic K-means clustering , 2008, 2008 19th International Conference on Pattern Recognition.

[4]  Frank Chongwoo Park,et al.  Robot sensor calibration: solving AX=XB on the Euclidean group , 1994, IEEE Trans. Robotics Autom..

[5]  Suresh Venkatasubramanian,et al.  The geometric median on Riemannian manifolds with application to robust atlas estimation , 2009, NeuroImage.

[6]  Venu Madhav Govindu.  Lie-algebraic averaging for globally consistent motion estimation , 2004, CVPR 2004.

[7]  H. Karcher,et al.  Jacobi fields and Finsler metrics on compact Lie groups with an application to differentiable pinching problems , 1974 .

[8]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using orthonormal matrices , 1988 .

[9]  Venu Madhav Govindu,et al.  Robustness in Motion Averaging , 2006, ACCV.

[10]  K. Hüper,et al.  On the Computation of the Karcher Mean on Spheres and Special Orthogonal Groups , 2007 .

[11]  William S. Massey,et al.  Algebraic Topology: An Introduction , 1977 .

[12]  S. Myers,et al.  Arcs and geodesics in metric spaces , 1945 .

[13]  H. Le,et al.  Estimation of Riemannian Barycentres , 2004 .

[14]  Robert Pless,et al.  Using many cameras as one , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[15]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[16]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[17]  Adam Morawiec.  A note on mean orientation , 1998 .

[18]  B. Afsari.  Riemannian Lp center of mass: existence, uniqueness, and convexity , 2011 .

[19]  Richard I. Hartley,et al.  Global Optimization through Rotation Space Search , 2009, International Journal of Computer Vision.

[20]  Ulrich Eckhardt,et al.  Weber's problem and weiszfeld's algorithm in general spaces , 1980, Math. Program..

[21]  Gerd Hirzinger,et al.  Optimal Hand-Eye Calibration , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  S. Altmann.  Rotations, Quaternions, and Double Groups , 1986 .

[23]  Reinhard Koch,et al.  Calibration of a Multi-camera Rig from Non-overlapping Views , 2007, DAGM-Symposium.

[24]  Hanqi Zhang,et al.  Hand/eye calibration for electronic assembly robots , 1998, IEEE Trans. Robotics Autom..

[25]  Michael Bosse,et al.  Calibrated, Registered Images of an Extended Urban Area , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[26]  Toshihisa Tanaka,et al.  An averaging method for a committee of special-orthogonal-group machines , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[27]  Robert Kaucic,et al.  Plane-based projective reconstruction , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[28]  Jan-Michael Frahm,et al.  Simple calibration of non-overlapping cameras with a mirror , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  A. Morawiec.  Comment on Determination of a mean orientation from a cloud of orientations. Application to electron back-scattering pattern measurements by Humbert et al. (1996) , 1998 .

[30]  Richard Hartley,et al.  Motion Estimation for Nonoverlapping Multicamera Rigs: Linear Algebraic and {\rm L}_\infty Geometric , 2010 .

[31]  Pierre-Antoine Absil,et al.  Riemannian BFGS Algorithm with Applications , 2010 .

[32]  E. Beltrami.  Teoria fondamentale degli spazii di curvatura costante , 1868 .

[33]  H. Le,et al.  Locating Fréchet means with application to shape spaces , 2001, Advances in Applied Probability.

[34]  Richard I. Hartley,et al.  Multiple-View Geometry Under the {$L_\infty$}-Norm , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  R. Hartley,et al.  L/sub /spl infin// minimization in geometric reconstruction problems , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[36]  P. Thomas Fletcher,et al.  Statistics of shape via principal geodesic analysis on Lie groups , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[37]  Jonathan H. Manton,et al.  A globally convergent numerical algorithm for computing the centre of mass on compact Lie groups , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[38]  Yuying Li,et al.  A Newton Acceleration of the Weiszfeld Algorithm for Minimizing the Sum of Euclidean Distances , 1995, Comput. Optim. Appl..

[39]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[40]  Bernhard Rinner,et al.  A Bright Future for Distributed Smart Cameras , 2008 .

[41]  Venu Madhav Govindu,et al.  Combining two-view constraints for motion estimation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[42]  Evangelos E. Milios,et al.  Globally Consistent Range Scan Alignment for Environment Mapping , 1997, Auton. Robots.

[43]  Robert E. Mahony,et al.  Optimization Algorithms on Matrix Manifolds , 2007 .

[44]  Adam Morawiec,et al.  Orientations and Rotations: Computations in Crystallographic Textures , 1999 .

[45]  R. Hartley,et al.  Rotation averaging and weak convexity , 2010 .

[46]  H. Karcher.  Riemannian center of mass and mollifier smoothing , 1977 .

[47]  Andreas Terzis,et al.  Distributed pose averaging in camera networks via consensus on SE(3) , 2008, 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras.

[48]  Peter Meer,et al.  Nonlinear Mean Shift over Riemannian Manifolds , 2009, International Journal of Computer Vision.

[49]  Michel Humbert,et al.  Response to Morawiec's (1998) comment on Determination of a mean orientation from a cloud of orientations. Application to electron back‐scattering pattern measurements , 1998 .

[50]  Michel Dhome,et al.  Flexible extrinsic calibration of non-overlapping cameras using a planar mirror: Application to vision-based robotics , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[51]  Maher Moakher,et al.  Means and Averaging in the Group of Rotations , 2002, SIAM J. Matrix Anal. Appl..

[52]  Le Yang.  Riemannian Median and Its Estimation , 2009, 0911.3474.

[53]  Claus Gramkow,et al.  On Averaging Rotations , 2001, International Journal of Computer Vision.

[54]  Y. Oshman,et al.  Averaging Quaternions , 2007 .

[55]  Jan-Michael Frahm,et al.  Robust 6DOF Motion Estimation for Non-Overlapping, Multi-Camera Systems , 2008, 2008 IEEE Workshop on Applications of Computer Vision.

[56]  Jan-Michael Frahm,et al.  Visual Odometry for Non-overlapping Views Using Second-Order Cone Programming , 2007, ACCV.

[57]  Nick Barnes,et al.  Rotation Averaging with Application to Camera-Rig Calibration , 2009, ACCV.

[58]  Jochen Trumpf,et al.  L1 rotation averaging using the Weiszfeld algorithm , 2011, CVPR 2011.

[59]  F. Kahl.  Multiple View Geometry and the L-infinity Norm , 2005, ICCV 2005.

[60]  J. Steiner.  Einige Gesetze über die Theilung der Ebene und des Raumes. , 1826 .

[61]  C. Goodall.  Procrustes methods in the statistical analysis of shape , 1991 .

[62]  Hongdong Li,et al.  Motion estimation for multi-camera systems using global optimization , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[63]  Richard J. Radke,et al.  Calibrating Distributed Camera Networks Using Belief Propagation , 2007, EURASIP J. Adv. Signal Process..

[64]  Zhanyi Hu,et al.  Cayley Transformation and Numerical Stability of Calibration Equation , 2008, International Journal of Computer Vision.

[65]  E. Cartan,et al.  Leçons sur la géométrie des espaces de Riemann , 1928 .

[66]  Peter F. Sturm,et al.  How to Compute the Pose of an Object Without a Direct View? , 2006, ACCV.

[67]  Carsten Rother,et al.  Linear Multi View Reconstruction and Camera Recovery , 2001, ICCV.

[68]  X. Pennec.  Computing the Mean of Geometric Features Application to the Mean Rotation , 1998 .

[69]  Wilfrid S. Kendall,et al.  Riemannian barycentres and geodesic convexity , 1999, Mathematical Proceedings of the Cambridge Philosophical Society.

[70]  C. Esling,et al.  Determination of a Mean Orientation from a Cloud of Orientations. Application to Electron Back-Scattering Pattern Measurements , 1996 .

[71]  Richard I. Hartley,et al.  Recovering Camera Motion Using L\infty Minimization , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[72]  William A. Harris,et al.  On the Computation of An , 1998, SIAM Rev..

[73]  Hongdong Li,et al.  A linear approach to motion estimation using generalized camera models , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[74]  Rui Rodrigues,et al.  Camera Pose Estimation Using Images of Planar Mirror Reflections , 2010, ECCV.

[75]  Gerald Sommer,et al.  On Averaging in Clifford Groups , 2004, IWMM/GIAE.

[76]  Alain Sarlette,et al.  Consensus Optimization on Manifolds , 2008, SIAM J. Control. Optim..

[77]  Motilal Agrawal,et al.  A Lie Algebraic Approach for Consistent Pose Registration for General Euclidean Motion , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[78]  Robert Pless,et al.  A spherical eye from multiple cameras (makes better models of the world) , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[79]  Wim Juli.  A Calculus Approach to Matrix Eigenvalue Algorithms , 2002 .

[80]  Tomás Pajdla,et al.  Robust Rotation and Translation Estimation in Multiview Reconstruction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.