Target Tracking for Visual Servoing Systems Based on an Adaptive Kalman Filter

Visual servoing has been around for decades, but time delay is still one of the most troublesome problems to achieve target tracking. To circumvent the problem, in this paper, the Kalman filter is employed to estimate the future position of the object. In order to introduce the Kalman filter, accurate time delays, which include the processing lag and the motion lag, need to be obtained. Thus, the delays of the visual control servoing systems are discussed and a generic timing model for the system is provided. Then, we present a current statistical model for a moving target. A fuzzy adaptive Kalman filter, which is evolved from the Kalman filter, is introduced based on the current statistical model. Finally, a two DOF visual controller based variable structure control law for micro-manipulation is presented. The results show that the proposed adaptive Kalman filter can improve the ability to track moving targets.

[1]  Raman K. Mehra,et al.  Approaches to adaptive filtering , 1970 .

[2]  V. Utkin.  Variable structure systems with sliding modes , 1977 .

[3]  R. Lynn Kirlin,et al.  Robust Adaptive Kalman Filtering with Unknown Inputs , 1986, 1986 American Control Conference.

[4]  M. Velger,et al.  Tracking targets with unknown process noise variance using adaptive Kalman filtering , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[5]  Tsutomu Kimoto,et al.  Manipulator control with image-based visual servo , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[6]  Takeo Kanade,et al.  Visual tracking of a moving target by a camera mounted on a robot: a combination of control and vision , 1993, IEEE Trans. Robotics Autom..

[7]  Peter K. Allen,et al.  Automated tracking and grasping of a moving object with a robotic hand-eye system , 1993, IEEE Trans. Robotics Autom..

[8]  John Y. Hung,et al.  Variable structure control: a survey , 1993, IEEE Trans. Ind. Electron..

[9]  Kazuyuki Kobayashi,et al.  Estimation of absolute vehicle speed using fuzzy logic rule-based Kalman filter , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[10]  Hideki Ogawa,et al.  A volleyball playing robot , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[11]  Sauro Longhi,et al.  Development and experimental validation of an adaptive extended Kalman filter for the localization of mobile robots , 1999, IEEE Trans. Robotics Autom..

[12]  A. H. Mohamed,et al.  Adaptive Kalman Filtering for INS/GPS , 1999 .

[13]  Jerzy Z. Sasiadek,et al.  Sensor fusion based on fuzzy Kalman filtering for autonomous robot vehicle , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[14]  Vadim I. Utkin,et al.  Sliding mode control in electromechanical systems , 1999 .

[15]  P. J. Escamilla-Ambrosio,et al.  A hybrid Kalman filter-fuzzy logic architecture for multisensor data fusion , 2001, Proceeding of the 2001 IEEE International Symposium on Intelligent Control (ISIC '01) (Cat. No.01CH37206).

[16]  P. J. Escamilla-Ambrosio,et al.  A HYBRID KALMAN FILTER-FUZZY LOGIC MULTISENSOR DATA FUSION ARCHITECTURE WITH FAULT TOLERANT CHARACTERISTICS , 2001 .

[17]  Fumio Miyazaki,et al.  Realization of the table tennis task based on virtual targets , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[18]  X. R. Li,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[19]  Ian D. Walker,et al.  A timing model for vision-based control of industrial robot manipulators , 2004, IEEE Transactions on Robotics.

[20]  Xinhan Huang,et al.  Three-Layered Control Architecture for Microassembly with Human-Robot Task Plan Interaction , 2004, 2004 IEEE International Conference on Robotics and Biomimetics.

[21]  Avinash C. Kak,et al.  A New Kalman-Filter-Based Framework for Fast and Accurate Visual Tracking of Rigid Objects , 2008, IEEE Transactions on Robotics.

[22]  N. Mort,et al.  ADAPTIVE KALMAN FILTERING THROUGH FUZZY LOGIC , 2008 .

[23]  Hyungsuck Cho,et al.  Microassembly of micropeg and -hole using uncalibrated visual servoing method , 2008 .

[24]  Xiangnan Li,et al.  A variable-structure IMM filtering algorithm based on current statistical model , 2009, 2009 International Conference on Mechatronics and Automation.

[25]  Min Wang,et al.  The Improved SVM Multi Objects's Identification for the Uncalibrated Visual Servoing , 2009 .

[26]  Xie Wei-xin,et al.  Current statistical model based on maximum entropy fuzzy clustering , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[27]  Ömer Faruk Durdu,et al.  Fuzzy logic adaptive Kalman filtering in the control of irrigation canals , 2010 .

[28]  Fei Li,et al.  Sliding mode variable structure control for visual servoing system , 2010, Int. J. Autom. Comput..

[29]  Asif Sabanoviç,et al.  Variable Structure Systems With Sliding Modes in Motion Control—A Survey , 2011, IEEE Transactions on Industrial Informatics.

[30]  Wilfried Hofmann,et al.  Improving Operational Performance of Active Magnetic Bearings Using Kalman Filter and State Feedback Control , 2012, IEEE Transactions on Industrial Electronics.