Aerial Border Surveillance for Search and Rescue Missions Using Eye Tracking Techniques

Aerial border surveillance is a crucial activity, which can assure the security of the country boarder and aid in search and rescue missions. This paper offers a novel “hands-free” tool for aerial border surveillance, search and rescue missions using head-mounted eye tracking technology. The contributions of this work are: i) a gaze based aerial boarder surveillance object classification and recognition framework; ii) real-time object detection and identification system in non-scanned regions; iii) investigating the scan-path (fixation and non-scanned) provided by mobile eye tracker can help improve training professional search and rescue organizations or even artificial intelligence robots for searching and rescuing missions. The proposed system architecture is further demonstrated using a dataset of large-scale real-life head-mounted eye tracking data.

[1]  D. Erdos,et al.  An experimental UAV system for search and rescue challenge , 2013, IEEE Aerospace and Electronic Systems Magazine.

[2]  Miad Faezipour,et al.  Eye Tracking and Head Movement Detection: A State-of-Art Survey , 2013, IEEE Journal of Translational Engineering in Health and Medicine.

[3]  Nathan D. Cahill,et al.  Computer vision enhances mobile eye-tracking to expose expert cognition in natural-scene visual-search tasks , 2014, Electronic Imaging.

[4]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[5]  Karen M. Evans,et al.  Analyzing complex gaze behavior in the natural world , 2011, Electronic Imaging.

[6]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[8]  Linden J. Ball,et al.  Eye tracking in HCI and usability research. , 2006 .

[9]  Jeremiah Gertler,et al.  Homeland Security: Unmanned Aerial Vehicles and Border Surveillance , 2010 .

[10]  Almudena Duque,et al.  Double attention bias for positive and negative emotional faces in clinical depression: evidence from an eye-tracking study. , 2015, Journal of behavior therapy and experimental psychiatry.

[11]  Oscar Déniz-Suárez,et al.  Face recognition using Histograms of Oriented Gradients , 2011, Pattern Recognit. Lett..

[12]  R. Pieters,et al.  A Review of Eye-Tracking Research in Marketing , 2008 .

[13]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[14]  Bryan Reimer,et al.  On-road driver eye movement tracking using head-mounted devices , 2002, ETRA.

[15]  J. MacQueen.  Some methods for classification and analysis of multivariate observations , 1967 .

[16]  Karen M. Evans,et al.  Collecting and Analyzing Eye-Tracking Data in Outdoor Environments , 2012 .

[17]  Daniel Sonntag,et al.  Gaze-guided object classification using deep neural networks for attention-based computing , 2016, UbiComp Adjunct.

[18]  Michael Burch,et al.  Visual Analytics Methodology for Eye Movement Studies , 2012, IEEE Transactions on Visualization and Computer Graphics.

[19]  Srinivas Sridharan,et al.  Gaze Guidance, Task-Based Eye Movement Prediction, and Real-World Task Inference using Eye Tracking , 2016 .