Nonlinear complementary filters on the special linear group

This article proposes a nonlinear complementary filter for the special linear Lie-group SL(3) that fuses low-frequency state measurements with partial velocity measurements and adaptive estimation of unmeasured slowly changing velocity components. The obtained results have direct application on the problem of filtering a sequence of image homographies acquired from low-quality video data. The considered application motivates us to derive results that provide adaptive estimation of the full group velocity or part of the group velocity that cannot be measured from sensors attached to the camera. We demonstrate the performance of the proposed filters on real world homography data.

[1]  Robert E. Mahony,et al.  Super-Resolution of Speed Signs in Video Sequences , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[2]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[3]  Thomas B. Schön,et al.  Modeling and Calibration of Inertial and Vision Sensors , 2010, Int. J. Robotics Res..

[4]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[5]  Robert E. Mahony,et al.  Dynamic estimation of homography transformations on the special linear group for visual servo control , 2009, 2009 IEEE International Conference on Robotics and Automation.

[6]  Frank Dellaert,et al.  Super-resolved texture tracking of planar surface patches , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[7]  Robert E. Mahony,et al.  Gradient-Like Observers for Invariant Dynamics on a Lie Group , 2008, IEEE Transactions on Automatic Control.

[8]  Rita Cunha,et al.  A nonlinear position and attitude observer on SE(3) using landmark measurements , 2010, Syst. Control. Lett..

[9]  M.S. de Queiroz,et al.  Homography-based visual servoing of wheeled mobile robots , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[10]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[11]  E. Malis,et al.  Estimation of Homography Dynamics on the Special Linear Group , 2010 .

[12]  Aníbal Ollero,et al.  Homography Based Kalman Filter for Mosaic Building. Applications to UAV position estimation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[13]  Youfu Li,et al.  Self-recalibration of a structured light system via plane-based homography , 2007, Pattern Recognit..

[14]  Michal Irani,et al.  Recovery of ego-motion using image stabilization , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Philippe Martin,et al.  Symmetry-Preserving Observers , 2006, IEEE Transactions on Automatic Control.

[16]  Miguel A. Olivares-Méndez,et al.  3D pose estimation based on planar object tracking for UAVs control , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  U. Helmke,et al.  Optimization and Dynamical Systems , 1994, Proceedings of the IEEE.

[18]  Philippe Martin,et al.  Non-linear observer on Lie Groups for left-invariant dynamics with right-left equivariant output , 2008 .

[19]  Roland Siegwart,et al.  Appearance-Guided Monocular Omnidirectional Visual Odometry for Outdoor Ground Vehicles , 2008, IEEE Transactions on Robotics.

[20]  Koichiro Deguchi,et al.  Optimal Motion Control for Image-Based Visual Servoing by Decoupling Translation and Rotation , 1999 .

[21]  Ki-Sang Hong,et al.  Affine Motion Based CMOS Distortion Analysis and CMOS Digital Image Stabilization , 2007, IEEE Transactions on Consumer Electronics.

[22]  Peter I. Corke,et al.  Editorial: Special Issue: 2nd Workshop on Integration of Vision and Inertial Sensors , 2007, Int. J. Robotics Res..

[23]  Christian Lageman,et al.  State observers for invariant dynamics on a Lie group , 2008 .

[24]  Wei Zou,et al.  Visual odometry based on locally planar ground assumption , 2005, 2005 IEEE International Conference on Information Acquisition.

[25]  Selim Benhimane,et al.  Homography-based 2D Visual Tracking and Servoing , 2007, Int. J. Robotics Res..

[26]  Olivier Faugeras,et al.  Motion and Structure from Motion in a piecewise Planar Environment , 1988, Int. J. Pattern Recognit. Artif. Intell..

[27]  Koichiro Deguchi,et al.  Optimal motion control for image-based visual servoing by decoupling translation and rotation , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[28]  Michael Bosse,et al.  Non-metric image-based rendering for video stabilization , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[29]  Robert E. Mahony,et al.  Nonlinear Complementary Filters on the Special Orthogonal Group , 2008, IEEE Transactions on Automatic Control.

[30]  Andrew Zisserman,et al.  Multiple View Geometry , 1999 .

[31]  E. Malis,et al.  Deeper understanding of the homography decomposition for vision-based control , 2007 .

[32]  Abdelhamid Tayebi,et al.  Attitude stabilization of a VTOL quadrotor aircraft , 2006, IEEE Transactions on Control Systems Technology.

[33]  Jorge Dias,et al.  Relative Pose Calibration Between Visual and Inertial Sensors , 2007, Int. J. Robotics Res..

[34]  Agostino Martinelli,et al.  Vision and IMU Data Fusion: Closed-Form Solutions for Attitude, Speed, Absolute Scale, and Bias Determination , 2012, IEEE Transactions on Robotics.

[35]  Philippe Martin,et al.  An Invariant Observer for Earth-Velocity-Aided Attitude Heading Reference Systems , 2008 .

[36]  Warren E. Dixon,et al.  Homography-based visual servo regulation of mobile robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[37]  Friedrich Fraundorfer,et al.  Topological mapping, localization and navigation using image collections , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .