An object following method based on computational geometry and PTAM for UAV in unknown environments

This paper introduces an object following method based on the computational geometry and PTAM for Unmanned Aerial Vehicle(UAV) in unknown environments. Since the object is easy to move out of the field of view(FOV) of the camera, and it is difficult to make it back to the field of camera view just by relative attitude control, we propose a novel solution to re-find the object based on the visual simultaneous localization and mapping (SLAM) results by PTAM. We use a pad as the object which includes a letter H surrounded by a circle. We can get the 3D position of the center of the circle in camera coordinate system using the computational geometry. When the object moves out of the FOV of the camera, the Kalman filter is used to predict the object velocity, so the pad can be searched effectively. We demonstrate that the ambiguity of the pad's localization has little impact on object following through experiments. The experimental results also validate the effectiveness and efficiency of the proposed method.

[1]  Leejay Wu,et al.  3D Interpretation of Conics and Or-thogonality , 1993 .

[2]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[3]  KanataniKenichi,et al.  3D interpretation of conics and orthogonality , 1993 .

[4]  Andreas Zell,et al.  An Onboard Monocular Vision System for Autonomous Takeoff, Hovering and Landing of a Micro Aerial Vehicle , 2012, Journal of Intelligent & Robotic Systems.

[5]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Gaurav S. Sukhatme,et al.  Visually guided landing of an unmanned aerial vehicle , 2003, IEEE Trans. Robotics Autom..

[7]  Daniel Cremers,et al.  Camera-based navigation of a low-cost quadrocopter , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Qian Chen,et al.  Camera Calibration with Two Arbitrary Coplanar Circles , 2004, ECCV.

[9]  Pascual Campoy Cervera,et al.  Computer vision based general object following for GPS-denied multirotor unmanned vehicles , 2014, 2014 American Control Conference.

[10]  T. Hamel,et al.  A practical Visual Servo Control for a Unmanned Aerial Vehicle , 2008, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[11]  Simone Duranti,et al.  Autonomous Landing of an Unmanned Helicopter based on Vision and Inertial Sensing , 2004, ISER.

[12]  Sven Lange,et al.  A vision based onboard approach for landing and position control of an autonomous multirotor UAV in GPS-denied environments , 2009, 2009 International Conference on Advanced Robotics.

[13]  Michel Dhome,et al.  Spatial Localization Of Modelled Objects Of Revolution In Monocular Perspective Vision , 1990, ECCV.

[14]  Pascual Campoy,et al.  Aerial object following using visual fuzzy servoing , 2011 .

[15]  Tully Foote,et al.  tf: The transform library , 2013, 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA).

[16]  Beno Benhabib,et al.  Three-dimensional location estimation of circular features for machine vision , 1992, IEEE Trans. Robotics Autom..

[17]  Miguel A. Olivares-Méndez,et al.  3D pose estimation based on planar object tracking for UAVs control , 2010, 2010 IEEE International Conference on Robotics and Automation.