Autonomous Person Detection and Tracking Framework Using Unmanned Aerial Vehicles (UAVs)

While person tracking has made significant progress over the last few years, most of the existing approaches are of limited success in real-time applications using moving sensors. In particular, we emphasize in this paper the need for a visual tracker that enables autonomous navigation functionality to drones (UAVs), mainly to follow a specific target. To achieve this goal, a color-based detection framework is proposed. The approach includes as well the execution of control commands, which are essential to switch from the detection to automatically follow the detected target. Our proposed approach is evaluated on videos recorded by drones. The obtained results demonstrate the effectiveness of the proposed approach to accurately follow a target in real-time, and despite different challenges such as lighting changes, speed, and occlusions.

[1]  Jean-Luc Dugelay,et al.  Color based soft biometry for hooligans detection , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[2]  David Hilbert,et al.  Color Constancy and the Complexity of Color , 2005 .

[3]  Gurjit Singh Walia,et al.  Recent advances on multicue object tracking: a survey , 2016, Artificial Intelligence Review.

[4]  Andreas Zell,et al.  Framework for Autonomous On-board Navigation with the AR.Drone , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[5]  Silvio Savarese,et al.  Ieee Transaction on Pattern Analysis and Machine Intelligence 1 a General Framework for Tracking Multiple People from a Moving Camera , 2022 .

[6]  Truong Q. Nguyen,et al.  Moving Object Detection With a Freely Moving Camera via Background Motion Subtraction , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Simone Calderara,et al.  Visual Tracking: An Experimental Survey , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Wu-Chih Hu,et al.  Moving object detection and tracking from video captured by moving camera , 2015, J. Vis. Commun. Image Represent..

[9]  Jean-Luc Dugelay,et al.  UAVs for humanitarian missions: Autonomy and reliability , 2014, IEEE Global Humanitarian Technology Conference (GHTC 2014).

[10]  Ling Shao,et al.  Recent advances and trends in visual tracking: A review , 2011, Neurocomputing.

[11]  Jin Hyeong Park,et al.  Performance evaluation of object detection algorithms , 2002, Object recognition supported by user interaction for service robots.

[12]  Hassan Noura,et al.  Quadrotor object tracking using real-time motion sensing , 2016, 2016 5th International Conference on Electronic Devices, Systems and Applications (ICEDSA).

[13]  Arnold W. M. Smeulders,et al.  Thirteen Hard Cases in Visual Tracking , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[14]  Basilio Bona,et al.  Object tracking with adaptive HOG detector and adaptive Rao-Blackwellised particle filter , 2011, Electronic Imaging.

[15]  Zhongfei Zhang,et al.  A survey of appearance models in visual object tracking , 2013, ACM Trans. Intell. Syst. Technol..

[16]  Florian Segor,et al.  Towards Autonomous Micro UAV Swarms , 2011, J. Intell. Robotic Syst..

[17]  Jean-Luc Dugelay,et al.  Enhancing human detection using crowd density measures and an adaptive correction filter , 2013, 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[18]  Hichem Snoussi,et al.  A reinforcement learning approach for UAV target searching and tracking , 2018, Multimedia Tools and Applications.

[19]  Jean-Luc Dugelay,et al.  Spatio-temporal crowd density model in a human detection and tracking framework , 2015, Signal Process. Image Commun..