Image-Based Pointing and Tracking for Inertially Stabilized Airborne Camera Platform

This paper describes a novel image-based pointing-tracking feedback control scheme for an inertially stabilized double-gimbal airborne camera platform combined with a computer vision system. The key idea is to enhance the intuitive decoupled controller structure with measurements of the camera inertial angular rate around its optical axis. The resulting controller can also compensate for the apparent translation between the camera and the observed object, but then the velocity of this mutual translation must be measured or estimated. Even though the proposed controller is more robust against longer sampling periods of the computer-vision system then the decoupled controller, a sketch of a simple compensation of this delay is also given. Numerical simulations are accompanied by laboratory experiments with a real benchmark system.

[1]  Jiri Matas,et al.  Training sequential on-line boosting classifier for visual tracking , 2008, 2008 19th International Conference on Pattern Recognition.

[2]  E. Malis,et al.  2 1/2 D Visual Servoing , 1999 .

[3]  J. Debruin,et al.  Control systems for mobile Satcom antennas , 2008, IEEE Control Systems.

[4]  François Chaumette,et al.  Visual servo control. I. Basic approaches , 2006, IEEE Robotics & Automation Magazine.

[5]  Seth Hutchinson,et al.  Multi-rate analysis and design of visual feedback digital servo control system , 1993 .

[6]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[8]  Kwang-Ting Cheng,et al.  SSD tracking using dynamic template and log-polar transformation , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[9]  Koichiro Deguchi,et al.  Optimal Motion Control for Image-Based Visual Servoing by Decoupling Translation and Rotation , 1999 .

[10]  Peter I. Corke,et al.  A new partitioned approach to image-based visual servo control , 2001, IEEE Trans. Robotics Autom..

[11]  J. M. Hilkert,et al.  Inertially stabilized platform technology Concepts and principles , 2008, IEEE Control Systems.

[12]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Supun Samarasekera,et al.  Aerial video surveillance and exploitation , 2001, Proc. IEEE.

[14]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[15]  A. K. Rue.  Stabilization of Precision Electrooptical Pointing and Tracking Systems , 1969, IEEE Transactions on Aerospace and Electronic Systems.

[16]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[17]  Zdenek Hurák,et al.  Delay compensation in a dual-rate cascade visual servomechanism , 2010, 49th IEEE Conference on Decision and Control (CDC).

[18]  R. Fuentes,et al.  Global analysis of the double-gimbal mechanism , 2008, IEEE Control Systems.

[19]  Gene F. Franklin,et al.  Digital Control Of Dynamic Systems 3rd Edition , 2014 .

[20]  Horst Bischof,et al.  Efficient Maximally Stable Extremal Region (MSER) Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[21]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[22]  M.K. Masten,et al.  Inertially stabilized platforms for optical imaging systems , 2008, IEEE Control Systems.

[23]  Zdenek Hurák,et al.  Combined line-of-sight inertial stabilization and visual tracking: application to an airborne camera platform , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[24]  Zdenek Hurák,et al.  Control design for image tracking with an inertially stabilized airborne camera platform , 2010, Defense + Commercial Sensing.

[25]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[26]  Ian Postlethwaite,et al.  Multivariable Feedback Control: Analysis and Design , 1996 .

[27]  Rs Roel Pieters,et al.  Visual Servo Control , 2012 .

[28]  Per Skoglar,et al.  Navigation Aided Image Processing in UAV Surveillance: Preliminary Results and Design of an Airborne Experimental System , 2004, J. Field Robotics.

[29]  A. Rue,et al.  Precision Stabilization Systems , 1974, IEEE Transactions on Aerospace and Electronic Systems.