Four-dimensional guidance and control of movement using time-to-contact: Application to automated docking and landing of unmanned rotorcraft systems

This paper presents the development and experimental validation of a bio-inspired autopilot, called TauPilot, based on the ecological tau theory proposed by the psychologist David Lee. Tau theory postulates that animals and humans use a combination of simple guidance strategies and the tau variable (τ) (representing time-to-contact) to prospectively guide and control most of their purposeful movements. This research investigates the feasibility and effectiveness of applying tau theory principles to guidance and control of movement in four dimensions (three spatial dimensions plus time), with application to various crucial maneuvres of unmanned aircraft systems (UAS) such as braking, automated aerial docking and automatic landing. TauPilot includes a tau-guidance system, a tau-navigation system and a tau-controller, resulting in a four-dimensional (4D) guidance, navigation and control system that has the capability to accurately fit maneuvres or actions into 4D slots using only the universal temporal variable, tau. TauPilot has been integrated into two rotorcraft UAS and demonstrated in more than 1000 successful tau-controlled flights. TauPilot provided the UAS with the capability to perform the following maneuvres with high spatial and temporal accuracy: tau-braking, 4D straight- and curved-path tau-docking to a virtual target (a three-dimensional point in space), vertical and 4D coordinated tau-landing, and 4D tau-interception of a moving target point.

[1]  David N. Lee,et al.  A Theory of Visual Control of Braking Based on Information about Time-to-Collision , 1976, Perception.

[2]  A. Krener,et al.  Nonlinear controllability and observability , 1977 .

[3]  R. Hirschorn,et al.  Output tracking for nonlinear systems with singular points , 1987 .

[4]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[5]  Yiannis Aloimonos,et al.  Obstacle Avoidance Using Flow Field Divergence , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  S. Zhang,et al.  Visual tracking of moving targets by freely flying honeybees , 1990, Visual Neuroscience.

[7]  B. Frost,et al.  Time to collision is signalled by neurons in the nucleus rotundus of pigeons , 1992, Nature.

[8]  P. Kokotovic,et al.  Nonlinear control via approximate input-output linearization: the ball and beam example , 1992 .

[9]  David N. Lee,et al.  VISUAL CONTROL OF VELOCITY OF APPROACH BY PIGEONS WHEN LANDING , 1993 .

[10]  Martin Herman,et al.  Real-time single-workstation obstacle avoidance using only wide-field flow divergence , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  Martin Herman,et al.  Real-time obstacle avoidance using central flow divergence and peripheral flow , 2017, Proceedings of IEEE International Conference on Computer Vision.

[12]  Leslie Pack Kaelbling,et al.  Ecological Robotics , 1998, Adapt. Behav..

[13]  David N. Lee.  Guiding Movement by Coupling Taus , 1998 .

[14]  Gareth D. Padfield,et al.  How do helicopter pilots know when to stop, turn or pull up? , 2001 .

[15]  J. Simmons,et al.  Steering by echolocation: a paradigm of ecological acoustics , 1995, Journal of Comparative Physiology A.

[16]  Mandyam V. Srinivasan,et al.  Landing Strategies in Honeybees and Applications to Uninhabited Airborne Vehicles , 2004, Int. J. Robotics Res..

[17]  Nicolas H. Franceschini,et al.  Optic flow regulation: the key to aircraft automatic guidance , 2005, Robotics Auton. Syst..

[18]  D. N. Lee,et al.  Aerial docking by hummingbirds , 1991, Naturwissenschaften.

[19]  Timothy W. McLain,et al.  Autonomous Landing of Miniature Aerial Vehicles , 2005 .

[20]  Dario Floreano,et al.  Fly-inspired visual steering of an ultralight indoor aircraft , 2006, IEEE Transactions on Robotics.

[21]  Michael Jump,et al.  Investigation of the Flare Maneuver Using Optical Tau , 2006 .

[22]  Paul F. M. J. Verschure,et al.  A fly-locust based neuronal control system applied to an unmanned aerial vehicle: the invertebrate neuronal principles for course stabilization, altitude control and collision avoidance , 2007, Int. J. Robotics Res..

[23]  Nick Barnes,et al.  A Robust Docking Strategy for a Mobile Robot Using Flow Field Divergence , 2006, IEEE Transactions on Robotics.

[24]  Paul Y. Oh,et al.  Optic-Flow-Based Collision Avoidance , 2008, IEEE Robotics & Automation Magazine.

[25]  James Sean Humbert,et al.  Implementation of wide-field integration of optic flow for autonomous quadrotor navigation , 2009, Auton. Robots.

[26]  Rogelio Lozano,et al.  An adaptive vision-based autopilot for mini flying machines guidance, navigation and control , 2009, Auton. Robots.

[27]  Dario Floreano,et al.  Vision-based control of near-obstacle flight , 2009, Auton. Robots.

[28]  David N. Lee.  General Tau Theory: evolution to date. , 2009, Perception.

[29]  Michael F. Land,et al.  Lee's 1976 Paper , 2009 .

[30]  Kazuyuki Ito,et al.  Determination of time to contact and application to timing control of mobile robot , 2010, 2010 IEEE International Conference on Robotics and Biomimetics.

[31]  Kenzo Nonami,et al.  Guidance and nonlinear control system for autonomous flight of minirotorcraft unmanned aerial vehicles , 2010, J. Field Robotics.

[32]  Mandyam V Srinivasan,et al.  Visual control of navigation in insects and its relevance for robotics , 2011, Current Opinion in Neurobiology.

[33]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[34]  Farid Kendoul,et al.  Bio-inspired TauPilot for automated aerial 4D docking and landing of Unmanned Aircraft Systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  Robert E. Mahony,et al.  Landing a VTOL Unmanned Aerial Vehicle on a Moving Platform Using Optical Flow , 2012, IEEE Transactions on Robotics.

[36]  Michael H Dickinson,et al.  The visual control of landing and obstacle avoidance in the fruit fly Drosophila melanogaster , 2012, Journal of Experimental Biology.

[37]  Farid Kendoul,et al.  Towards a Unified Framework for UAS Autonomy and Technology Readiness Assessment (ATRA) , 2013 .