A platform stabilization algorithm based on feedforward visual-inertial servoing

This paper presents a method of improving performance of visual servoing system by integrating inertial sensors to the system. The method is applied to a roll and pitch rotated platform stabilization in high control frequency. For the purpose, an inertial measurement unit is attached to the platform to provide its dynamics information. A new inertial information based feedforward control is used along with the conventional visual feedback control. Two contributions are realized: first, it helps solve the remaining limitation of static-object assumption in conventional visual servoing. Second, it helps drastically improve the response rate of the servoing system due to the utilization of a high-speed inertial measurement unit. Stability of the control system is analyzed such that the error of the system is proved to be bounded. Control algorithm was simulated using Matlab Aerospace Toolbox as well as Robotics Toolbox. Then, experiments were implemented to verify the feasibility of the proposed methodology.

[1]  Thomas B. Schön,et al.  Sensor Fusion for Augmented Reality , 2006, 2006 9th International Conference on Information Fusion.

[2]  Babu Joseph,et al.  Techniques of Model-Based Control , 2002 .

[3]  Lars Hoff,et al.  Validation of cardiac accelerometer sensor measurements. , 2009, Physiological measurement.

[4]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[5]  Peter I. Corke,et al.  A robotics toolbox for MATLAB , 1996, IEEE Robotics Autom. Mag..

[6]  Sangchul Lee,et al.  Test and error parameter estimation for MEMS — based low cost IMU calibration , 2011 .

[7]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[8]  François Chaumette,et al.  Visual servo control. II. Advanced approaches [Tutorial] , 2007, IEEE Robotics & Automation Magazine.

[9]  Markus Vincze,et al.  Fusion of Vision and Inertial Data for Motion and Structure Estimation , 2004 .

[10]  Peter Corke,et al.  An Introduction to Inertial and Visual Sensing , 2007, Int. J. Robotics Res..

[11]  Éric Marchand,et al.  ViSP for visual servoing: a generic software platform with a wide class of robot control skills , 2005, IEEE Robotics & Automation Magazine.

[12]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[13]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[14]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[15]  A. B. Chatfield.  Fundamentals of high accuracy inertial navigation , 1997 .

[16]  Giuseppe Oriolo,et al.  Image-Based Visual Servoing for Nonholonomic Mobile Robots Using Epipolar Geometry , 2007, IEEE Transactions on Robotics.

[17]  Hee-Jun Kang,et al.  A visual-inertial servoing method for tracking object with two landmarks and an inertial measurement unit , 2011 .

[18]  Hee-Jun Kang,et al.  A DCM Based Orientation Estimation Algorithm with an Inertial Measurement Unit and a Magnetic Compass , 2009, J. Univers. Comput. Sci..

[19]  Jorge Dias,et al.  Vision and Inertial Sensor Cooperation Using Gravity as a Vertical Reference , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Luc Soler,et al.  Active filtering of physiological motion in robotized surgery using predictive control , 2005, IEEE Transactions on Robotics.

[21]  Fumio Miyazaki,et al.  Visual servoing of the manipulator using the stereo vision , 1993, Proceedings of IECON '93 - 19th Annual Conference of IEEE Industrial Electronics.