Visual Servoing of Unmanned Surface Vehicle from Small Tethered Unmanned Aerial Vehicle

This paper presents an algorithm and the implementation of a motor schema to aid the visual localization subsystem of the ongoing EMILY project at Texas A and M University. The EMILY project aims to team an Unmanned Surface Vehicle (USV) with an Unmanned Aerial Vehicle (UAV) to augment the search and rescue of marine casualties during an emergency response phase. The USV is designed to serve as a flotation device once it reaches the victims. A live video feed from the UAV is provided to the casuality responders giving them a visual estimate of the USVs orientation and position to help with its navigation. One of the challenges involved with casualty response using a USV UAV team is to simultaneously control the USV and track it. In this paper, we present an implemented solution to automate the UAV camera movements to keep the USV in view at all times. The motor schema proposed, uses the USVs coordinates from the visual localization subsystem to control the UAVs camera movements and track the USV with minimal camera movements such that the USV is always in the cameras field of view.

[1]  Robin R. Murphy,et al.  Visual pose estimation of USV from UAV to assist drowning victims recovery , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[2]  Min Tan,et al.  A novel pan-tilt camera control approach for visual tracking , 2014, Proceeding of the 11th World Congress on Intelligent Control and Automation.

[3]  Mongi A. Abidi,et al.  Real-time video tracking using PTZ cameras , 2003, International Conference on Quality Control by Artificial Vision.

[4]  GyongIl Ryang,et al.  Pan-Tilt Camera and PIR Sensor Fusion Based Moving Object Detection for Mobile Security Robots , 2015, ArXiv.

[5]  Robin R. Murphy,et al.  Use of remotely operated marine vehicles at Minamisanriku and Rikuzentakata Japan for disaster recovery , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[6]  Zhenbang Gong,et al.  A Pan-tilt Camera Control System of UAV Visual Tracking Based on Biomimetic Eye , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[7]  Alan L. Jennings,et al.  Optical Flow Background Estimation for Real-time Pan/tilt Camera Object Tracking , 2014 .

[8]  Robin R. Murphy,et al.  Marine heterogeneous multirobot systems at the great Eastern Japan Tsunami recovery , 2012, J. Field Robotics.

[9]  Robin R. Murphy,et al.  Cooperative use of unmanned sea surface and micro aerial vehicles at Hurricane Wilma , 2008 .

[10]  Robin R. Murphy,et al.  Cooperative Damage Inspection with Unmanned Surface Vehicle and Micro Unmanned Aerial Vehicle at Hurricane Wilma , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Robin R. Murphy,et al.  UAV assisted USV visual navigation for marine mass casualty incident response , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Robin R. Murphy,et al.  Unmanned marine vehicle use at Hurricanes Wilma and Ike , 2009, OCEANS 2009.

[13]  Ieee Staff OCEANS 2009, MTS/IEEE Biloxi - Marine Technology for Our Future: Global and Local Challenges , 2009 .