Simplified mirror-based camera pose computation via rotation averaging

We propose a novel approach to compute the camera pose with respect to a reference object given only mirrored views. The latter originate from a planar mirror at different unknown poses. This problem is highly relevant in several extrinsic camera calibration scenarios, where the camera cannot see the reference object directly. In contrast to numerous existing methods, our approach does not employ the fixed axis rotation constraint, but represents a more elegant formulation as a rotation averaging problem. Our theoretical contribution extends the applicability of rotation averaging to a more general case, and enables mirror-based pose estimation in closed-form under the chordal L2-metric, or in an outlier-robust way by employing iterative L1-norm averaging. We demonstrate the advantages of our approach on both synthetic and real data, and show how the method can be applied to calibrate the non-overlapping pair of cameras of a common smart phone.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  XuChi,et al.  A Robust O(n) Solution to the Perspective-n-Point Problem , 2012 .

[3]  Kenichi Kanatani,et al.  Analysis of 3-D Rotation Fitting , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Peter F. Sturm,et al.  How to Compute the Pose of an Object Without a Direct View? , 2006, ACCV.

[5]  Jay P. Fillmore A Note on Rotation Matrices , 1984, IEEE Computer Graphics and Applications.

[6]  Nick Barnes,et al.  Rotation Averaging with Application to Camera-Rig Calibration , 2009, ACCV.

[7]  Hongdong Li,et al.  Rotation Averaging , 2013, International Journal of Computer Vision.

[8]  Shree K. Nayar,et al.  Catadioptric Stereo Using Planar Mirrors , 2001, International Journal of Computer Vision.

[9]  Amit K. Agrawal,et al.  Single Image Calibration of Multi-axial Imaging Systems , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Shiqi Li,et al.  A Robust O(n) Solution to the Perspective-n-Point Problem , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Joel A. Hesch,et al.  Mirror-Based Extrinsic Camera Calibration , 2008, WAFR.

[12]  Takashi Matsuyama,et al.  A new mirror-based extrinsic camera calibration using an orthogonality constraint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Richard I. Hartley,et al.  Optimal Algorithms in Multiview Geometry , 2007, ACCV.

[14]  Jan-Michael Frahm,et al.  Simple calibration of non-overlapping cameras with a mirror , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Adam Morawiec,et al.  Orientations and Rotations , 2004 .

[16]  Rui Rodrigues,et al.  Camera Pose Estimation Using Images of Planar Mirror Reflections , 2010, ECCV.