A bio-inspired methodology of automatic perching for unmanned aerial vehicles

i Abstract Current unmanned aerial vehicles (UAVs) have to stay airborne during surveillance missions, decreasing their energy efficiency dramatically and therefore limiting their endurance significantly. On the other hand, birds perch to conserve energy while maintaining surveillance over their domain. A biomimetic methodology of automatic perching for UAVs is thus a promising solution to their endurance problem. Firstly, an experimental study of parrots’ perching is conducted to obtain bioinspirations of perching principles, and the perching procedure is generalized into three stages following which the perching methodology is addressed. Secondly, varying tau-dot, as observed from the approaching flight of parrots, is proposed with a fuzzy logic for perching flight guidance of UAVs and it outperforms the conventional assumption of constant tau-dot in terms of flight time. Thirdly, a scaledependent expansion model (SEM) is derived for visual perception of tau-dot, and three visual identification algorithms are evaluated for best perception performance. Experiment results verify the effectiveness of the SEM, making onboard autonomous guidance possible. However, improvement on perception accuracy and reliability is still needed. Fourthly, a two-dimensional perching model of quadrotors covering dynamic interaction with perch is established based on analysis of the balancing procedure of parrots after touchdown. Simulation validates the applicability of the model to biomimetic perching. Finally, a gripping perching mechanism featuring force amplification and sensing is designed, and a fuzzy control law is proposed for automatic gripping. Experiments of indoor and outdoor remotely controlled perching, indoor automatic perching, and dynamic automatic gripping are performed, and results show that the perching mechanism is capable of fulfilling reliable and automatic attachment to perch. The proposed methodology of automatic perching for UAVs covers the complete perching procedure, although its effectiveness has only been verified for each perching stage individually. Future work on enhancement of each component of the methodology and their integration can be done to validate overall effectiveness.

[1]  Farid Kendoul,et al.  Bio-inspired TauPilot for automated aerial 4D docking and landing of Unmanned Aircraft Systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  E Andrada,et al.  Kinematics and center of mass mechanics during terrestrial locomotion in northern lapwings (Vanellus vanellus, Charadriiformes). , 2012, Journal of experimental zoology. Part A, Ecological genetics and physiology.

[3]  Daniel Cremers,et al.  Scale-aware navigation of a low-cost quadrocopter with a monocular camera , 2014, Robotics Auton. Syst..

[4]  Apostolos P. Georgopoulos,et al.  Guiding contact by coupling the taus of gaps , 2001, Experimental Brain Research.

[5]  P. R. Green,et al.  Optic flow-field variables trigger landing in hawk but not in pigeons , 1990, Naturwissenschaften.

[6]  Andrew J. Davison,et al.  DTAM: Dense tracking and mapping in real-time , 2011, 2011 International Conference on Computer Vision.

[7]  R. Norberg,et al.  WHY FORAGING BIRDS IN TREES SHOULD CLIMB AND HOP UPWARDS RATHER THAN DOWNWARDS , 2008 .

[8]  John J. Leonard,et al.  Robust real-time visual odometry for dense RGB-D mapping , 2013, 2013 IEEE International Conference on Robotics and Automation.

[9]  David N. Lee,et al.  A Theory of Visual Control of Braking Based on Information about Time-to-Collision , 1976, Perception.

[10]  S C Burgess,et al.  Multi-modal locomotion: from animal to application , 2013, Bioinspiration & biomimetics.

[11]  Horst Bischof,et al.  Dense reconstruction on-the-fly , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Ou Ma,et al.  A Bio-inspired Approach for UAV Landing and Perching , 2013 .

[13]  Vaibhav Ghadiok,et al.  Autonomous indoor aerial gripping using a quadrotor , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Sergio Salazar,et al.  Vision-based autonomous hovering for a miniature quad-rotor , 2014, Robotica.

[15]  Michael Jump,et al.  Progress in the development of guidance strategies for the landing flare manoeuvre using tau‐based parameters , 2006 .

[16]  Rayner,et al.  Measuring leg thrust forces in the common starling , 1996, The Journal of experimental biology.

[17]  Timothy A. Yates,et al.  A test of the tau-dot hypothesis of braking control in the real world. , 2006, Journal of experimental psychology. Human perception and performance.

[18]  A. M. Berg,et al.  Kinematics and power requirements of ascending and descending flight in the pigeon (Columba livia) , 2008, Journal of Experimental Biology.

[19]  Mark A. Minor,et al.  Avian-inspired passive perching mechanism for robotic rotorcraft , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  P. Green,et al.  Head-bobbing and head orientation during landing flights of pigeons , 1994, Journal of Comparative Physiology A.

[21]  Daniel Cremers,et al.  Dense visual SLAM for RGB-D cameras , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[23]  Zdenko Kovacic,et al.  Fuzzy Controller Design: Theory and Applications , 2005 .

[24]  Thomas Klinger,et al.  Image Processing with LabVIEW and IMAQ Vision , 2003 .

[25]  Mark R. Cutkosky,et al.  Landing and Perching on Vertical Surfaces with Microspines for Small Unmanned Air Vehicles , 2010, J. Intell. Robotic Syst..

[26]  A. Pike,et al.  Scaling of bird claws , 2004 .

[27]  M. Fujita Head bobbing and the movement of the centre of gravity in walking pigeons ( Columba livia ) , 2002 .

[28]  Zhen Zhang,et al.  Bio-inspired trajectory generation for UAV perching , 2013, 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[29]  Andrew A Biewener,et al.  Muscle function during takeoff and landing flight in the pigeon (Columba livia) , 2012, Journal of Experimental Biology.

[30]  Kok-Meng Lee,et al.  A vision-guided fuzzy logic control system for dynamic pursuit of a moving target , 1998, Microprocess. Microsystems.

[31]  Albert Albers,et al.  Semi-autonomous flying robot for physical interaction with environment , 2010, 2010 IEEE Conference on Robotics, Automation and Mechatronics.

[32]  R. Szeliski,et al.  Incremental estimation of dense depth maps from image sequences , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Mandyam V. Srinivasan,et al.  Optic Flow Cues Guide Flight in Birds , 2011, Current Biology.

[34]  A. M. Berg,et al.  Wing and body kinematics of takeoff and landing flight in the pigeon (Columba livia) , 2010, Journal of Experimental Biology.

[35]  K. H. Low,et al.  An optimized perching mechanism for autonomous perching with a quadrotor , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[36]  Aaron M. Dollar,et al.  Hovering Stability of Helicopters With Elastic Constraints , 2010 .

[37]  Shi Kang Chong Visual-guided perching of quadrotors , 2015 .

[38]  W H Warren,et al.  Visual control of braking: a test of the tau hypothesis. , 1995, Journal of experimental psychology. Human perception and performance.

[39]  Farid Kendoul,et al.  Four-dimensional guidance and control of movement using time-to-contact: Application to automated docking and landing of unmanned rotorcraft systems , 2014, Int. J. Robotics Res..

[40]  Michael H Dickinson,et al.  The visual control of landing and obstacle avoidance in the fruit fly Drosophila melanogaster , 2012, Journal of Experimental Biology.

[41]  Ou Ma,et al.  Bioinspired 4D Trajectory Generation for a UAS Rapid Point-to-Point Movement , 2014 .

[42]  H. Wagner Flow-field variables trigger landing in flies , 1982, Nature.

[43]  S. Vogt,et al.  Braking Reaching Movements: A Test of the Constant Tau-Dot Strategy Under Different Viewing Conditions , 2004, Journal of motor behavior.

[44]  B. Tobalske,et al.  Transition from wing to leg forces during landing in birds , 2014, Journal of Experimental Biology.

[45]  Gert-Jan Pepping,et al.  Extrinsic tau-coupling and the regulation of interceptive reaching under varying task constraints. , 2014, Motor control.

[46]  David N. Lee,et al.  Sensory and intrinsic coordination of movement , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[47]  Aaron M. Dollar,et al.  UAV rotorcraft in compliant contact: Stability analysis and simulation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[48]  Harvey I. Fisher The Landing Forces of Domestic Pigeons , 1956 .

[49]  Christoph Hürzeler,et al.  A perching mechanism for micro aerial vehicles , 2009 .

[50]  Mirna Issa,et al.  Adaptive neuro fuzzy controller for adaptive compliant robotic gripper , 2012, Expert Syst. Appl..

[51]  Vijay Kumar,et al.  Trajectory Generation and Control for Precise Aggressive Maneuvers with Quadrotors , 2010, ISER.

[52]  Kimon P. Valavanis,et al.  Advances in Unmanned Aerial Vehicles: State of the Art and the Road to Autonomy , 2007 .

[53]  B. Tobalske,et al.  Transition from leg to wing forces during take-off in birds , 2012, Journal of Experimental Biology.

[54]  Kye-Si Kwon,et al.  Practical Guide to Machine Vision Software: An Introduction with LabVIEW , 2014 .

[55]  Russ Tedrake,et al.  Experiments in Fixed-Wing UAV Perching , 2008 .

[56]  Daniel D. Jensen,et al.  The Sticky-Pad Plane and other Innovative Concepts for Perching UAVs , 2009 .

[57]  M. Srinivasan,et al.  The moment before touchdown: landing manoeuvres of the honeybee Apis mellifera , 2010, Journal of Experimental Biology.

[58]  Norbert Boeddeker,et al.  A universal strategy for visually guided landing , 2013, Proceedings of the National Academy of Sciences.

[59]  Russ Tedrake,et al.  On the controllability of fixed-wing perching , 2009, 2009 American Control Conference.

[60]  Rogelio Lozano,et al.  Real-Time Stabilization of an Eight-Rotor UAV Using Optical Flow , 2009, IEEE Transactions on Robotics.

[61]  T. Dorsam,et al.  Fuzzy-based grasp-force-adaptation for multifingered robot hands , 1994, Proceedings of 1994 IEEE 3rd International Fuzzy Systems Conference.

[62]  D. Fowler,et al.  Predatory Functional Morphology in Raptors: Interdigital Variation in Talon Size Is Related to Prey Restraint and Immobilisation Technique , 2009, PloS one.

[63]  D. Pines,et al.  Challenges Facing Future Micro-Air-Vehicle Development , 2006 .

[64]  David N. Lee,et al.  VISUAL CONTROL OF VELOCITY OF APPROACH BY PIGEONS WHEN LANDING , 1993 .

[65]  Mark R. Cutkosky,et al.  Modeling the dynamics of perching with opposed-grip mechanisms , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[66]  Harvey I. Fisher Apparatus to Measure Forces Involved in the Landing and Taking Off of Birds , 1956 .

[67]  Kazuyuki Ito,et al.  Determination of time to contact and application to timing control of mobile robot , 2010, 2010 IEEE International Conference on Robotics and Biomimetics.

[68]  Mark R. Cutkosky,et al.  Hybrid aerial and scansorial robotics , 2010, 2010 IEEE International Conference on Robotics and Automation.

[69]  P. Galton,et al.  Experimental analysis of perching in the European starling (Sturnus vulgaris: Passeriformes; Passeres), and the automatic perching mechanism of birds. , 2012, Journal of experimental zoology. Part A, Ecological genetics and physiology.

[70]  Green,et al.  Variation in kinematics and dynamics of the landing flights of pigeons on a novel perch , 1998, The Journal of experimental biology.

[71]  T. H. Quinn,et al.  Chiropteran tendon locking mechanism , 1993, Journal of morphology.

[72]  A. Nagendran,et al.  Biologically inspired legs for UAV perched landing , 2012, IEEE Aerospace and Electronic Systems Magazine.

[73]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[74]  M. A. Minor,et al.  An Avian-Inspired Passive Mechanism for Quadrotor Perching , 2013, IEEE/ASME Transactions on Mechatronics.

[75]  M. Srinivasan,et al.  Landing Strategies in Honeybees, and Possible Applications to Autonomous Airborne Vehicles , 2001, The Biological Bulletin.

[76]  Tyson L Hedrick,et al.  Damping in flapping flight and its implications for manoeuvring, scaling and evolution , 2011, Journal of Experimental Biology.

[77]  Frank H. Heppner,et al.  Leg Thrust Important in Flight Take-Off in the Pigeon , 1985 .

[78]  Kaustubh Pathak,et al.  Approaches for a tether-guided landing of an autonomous helicopter , 2006, IEEE Transactions on Robotics.

[79]  Daniel Cremers,et al.  Robust odometry estimation for RGB-D cameras , 2013, 2013 IEEE International Conference on Robotics and Automation.

[80]  Daniel Cremers,et al.  Camera-based navigation of a low-cost quadrocopter , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[81]  Roland Siegwart,et al.  Onboard IMU and monocular vision based control for MAVs in unknown in- and outdoor environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[82]  Martin Herman,et al.  Real-time obstacle avoidance using central flow divergence and peripheral flow , 2017, Proceedings of IEEE International Conference on Computer Vision.

[83]  M. V. Srinivasan,et al.  Freely flying honeybees use image motion to estimate object distance , 1989, Naturwissenschaften.

[84]  Farid Kendoul,et al.  Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems , 2012, J. Field Robotics.

[85]  T. H. Quinn,et al.  The digital tendon locking mechanism of the avian foot (Aves) , 1990, Zoomorphology.

[86]  L. Kaufman,et al.  The Stability and Control of Tethered Helicopters , 1962 .

[87]  Dalibor Petkovic,et al.  Adaptive neuro fuzzy estimation of underactuated robotic gripper contact forces , 2013, Expert Syst. Appl..

[88]  Zhang,et al.  Honeybee navigation en route to the goal: visual flight control and odometry , 1996, The Journal of experimental biology.

[89]  Berg,et al.  The moment of inertia of bird wings and the inertial power requirement for flapping flight , 1995, The Journal of experimental biology.

[90]  Ou Ma,et al.  Bio-Inspired Trajectory Generation for UAV Perching Movement Based on Tau Theory , 2014 .

[91]  David N. Lee General Tau Theory: evolution to date. , 2009, Perception.

[92]  Ephrahim Garcia,et al.  Longitudinal dynamics of a perching aircraft , 2006 .

[93]  Daniel Mellinger,et al.  Control of Quadrotors for Robust Perching and Landing , 2010 .

[94]  Chidentree Treesatayapun,et al.  Adaptive control based on IF-THEN rules for grasping force regulation with unknown contact mechanism , 2014 .

[95]  Paul B Rock,et al.  Tau as a potential control variable for visually guided braking. , 2006, Journal of experimental psychology. Human perception and performance.

[96]  Marcello R. Napolitano,et al.  A Survey of Optical Flow Techniques for Robotics Navigation Applications , 2014, J. Intell. Robotic Syst..

[97]  Ephrahim Garcia,et al.  Optimization of Perching Maneuvers Through Vehicle Morphing , 2008 .

[98]  Nikos A. Aspragathos,et al.  Fuzzy logic grasp control using tactile sensors , 2001 .

[99]  Gurjot Singh Gaba,et al.  Image Recognition System using Geometric Matching and Contour Detection , 2012 .

[100]  David N. Lee Guiding Movement by Coupling Taus , 1998 .