Joint Geometric and Photometric Visual Tracking Based on Lie Group

This paper presents a novel efficient and robust direct visual tracking method under illumination variations. In our approach, non-Euclidean Lie group characteristics of both geometric and photometric transformations are exploited. These transformations form Lie groups and are parameterized by their corresponding Lie algebras. By applying the efficient second-order minimization trick, we derive an efficient second-order optimization technique for jointly solving the geometric and photometric parameters. Our approach has a high convergence rate and low iterations. Moreover, our approach is almost not affected by linear illumination variations. The superiority of our proposed method over the existing direct methods, in terms of efficiency and robustness is demonstrated through experiments on synthetic and real data.

[1]  Adrien Bartoli,et al.  Groupwise Geometric and Photometric Direct Image Registration , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Georgios D. Evangelidis,et al.  Parametric Image Alignment Using Enhanced Correlation Coefficient Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Brett Browning,et al.  Robust Tracking in Low Light and Sudden Illumination Changes , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[4]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[5]  Aleksandra Pizurica,et al.  Joint photometric and geometric image registration in the total least square sense , 2011, Pattern Recognit. Lett..

[6]  Éric Marchand,et al.  Second-Order Optimization of Mutual Information for Real-Time Image Registration , 2012, IEEE Transactions on Image Processing.

[7]  Geraldo F. Silveira,et al.  Real-time Visual Tracking under Arbitrary Illumination Changes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Russell H. Taylor,et al.  Visual tracking using the sum of conditional variance , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Geraldo F. Silveira,et al.  Unified Direct Visual Tracking of Rigid and Deformable Surfaces Under Generic Illumination Changes in Grayscale and Color Images , 2010, International Journal of Computer Vision.

[10]  Mohamed M. Fouad,et al.  Image Registration Under Illumination Variations Using Region-Based Confidence Weighted $M$-Estimators , 2012, IEEE Transactions on Image Processing.

[11]  Alain Trémeau,et al.  A study on local photometric models and their application to robust tracking , 2012, Comput. Vis. Image Underst..

[12]  Selim Benhimane,et al.  Homography-based 2D Visual Tracking and Servoing , 2007, Int. J. Robotics Res..