Multi-Camera Videography Methods for Aeroecology

The ability to study the behavior of flying animals in their natural environment has been dramatically improved by recent advances in imaging technologies and video analysis tools. Stereo videography, in particular, has taken aeroecology to a new level. We here describe methods for estimating the three-dimensional flight paths of animals from image data recorded simultaneously by multiple visible-light or infrared cameras. We explain how the accuracy of these estimates is influenced by camera properties and placements, as well as calibration procedures. We include a description of potential pitfalls drawn from field experience with various bat and bird species and show some example stereoscopic reconstructions of bat and bird flight.

[1]  Margrit Betke,et al.  Coupling detection and data association for multiple object tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Margrit Betke,et al.  Tracking a large number of objects from multiple views , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Manuela M. Veloso,et al.  Automatically tracking and analyzing the behavior of live insect colonies , 2001, AGENTS '01.

[4]  Tyson L Hedrick,et al.  Software techniques for two- and three-dimensional kinematic measurements of biological and biomimetic systems , 2008, Bioinspiration & biomimetics.

[5]  Margrit Betke,et al.  Applications of thermal infrared imaging for research in aeroecology. , 2008, Integrative and comparative biology.

[6]  R. Sikes,et al.  Guidelines of the American Society of Mammalogists for the Use of Wild Mammals in Research , 2007 .

[7]  John K. Westbrook,et al.  Brazilian free-tailed bats (Tadarida brasiliensis) as insect pest regulators in transgenic and conventional cotton crops , 2008 .

[8]  Margrit Betke,et al.  3D pose estimation of bats in the wild , 2014, IEEE Winter Conference on Applications of Computer Vision.

[9]  Alan H. Strahler,et al.  Study of bat flight behavior by combining thermal image analysis with a LiDAR forest reconstruction , 2013 .

[10]  Margrit Betke,et al.  Thermal Imaging Reveals Significantly Smaller Brazilian Free-Tailed Bat Colonies Than Previously Estimated , 2008, Journal of Mammalogy.

[11]  Margrit Betke,et al.  Seasonal variation in colony size of Brazilian free-tailed bats at Carlsbad Cavern based on thermal imaging , 2010 .

[12]  Tyson L Hedrick,et al.  Three-dimensional trajectories and network analyses of group behaviour within chimney swift flocks during approaches to the roost , 2017, Proceedings of the Royal Society B: Biological Sciences.

[13]  Margrit Betke,et al.  A Thermal Infrared Video Benchmark for Visual Analysis , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[14]  Margrit Betke,et al.  Brazilian free-tailed bats as insect pest regulators in transgenic and conventional cotton crops. , 2008, Ecological applications : a publication of the Ecological Society of America.

[15]  Margrit Betke,et al.  Collision avoidance in biological systems using collision cones , 2013, 2013 American Control Conference.

[16]  Margrit Betke,et al.  Dense and sparse aggregations in complex motion: Video coupled with simulation modeling , 2010 .

[17]  Jan Mayer,et al.  A numerical evaluation of preprocessing and ILU-type preconditioners for the solution of unsymmetric sparse linear systems using iterative methods , 2009, TOMS.

[18]  Jason W. Horn,et al.  Aeroecology: probing and modeling the aerosphere. , 2007, Integrative and comparative biology.

[19]  Richard A. Brown,et al.  Introduction to random signals and applied kalman filtering (3rd ed , 2012 .

[20]  Margrit Betke,et al.  Optical flow sensing and the inverse perception problem for flying bats , 2013, 52nd IEEE Conference on Decision and Control.

[21]  Adrian L. R. Thomas,et al.  Photogrammetric reconstruction of high-resolution surface topographies and deformable wing kinematics of tethered locusts and free-flying hoverflies , 2009, Journal of The Royal Society Interface.

[22]  C F Moss,et al.  A computational sensorimotor model of bat echolocation. , 2001, The Journal of the Acoustical Society of America.

[23]  Giorgio Parisi,et al.  The STARFLAG handbook on collective animal behaviour: 1. Empirical methods , 2008, Animal Behaviour.

[24]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[25]  C. J. Clark,et al.  Courtship dives of Anna's hummingbird offer insights into flight performance limits , 2009, Proceedings of the Royal Society B: Biological Sciences.

[26]  Margrit Betke,et al.  Tracking Large Variable Numbers of Objects in Clutter , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Tyson L. Hedrick,et al.  Wing inertia and whole-body acceleration: an analysis of instantaneous aerodynamic force production in cockatiels (Nymphicus hollandicus) flying across a range of speeds , 2004, Journal of Experimental Biology.

[28]  Andrea Cavagna,et al.  Tracking in three dimensions via recursive multi-path branching , 2013 .

[29]  Rama Chellappa,et al.  Shape-and-Behavior Encoded Tracking of Bee Dances , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Andrea Cavagna,et al.  Emergence of collective changes in travel direction of starling flocks from individual birds' fluctuations , 2014, Journal of The Royal Society Interface.

[31]  Zhaodan Kong,et al.  Perception and Steering Control in Paired Bat Flight , 2013, ArXiv.

[32]  F. Dellaert,et al.  A Rao-Blackwellized particle filter for EigenTracking , 2004, CVPR 2004.

[33]  Jian Chen,et al.  Quantifying the complexity of bat wing kinematics. , 2008, Journal of theoretical biology.

[34]  Andrew Calway,et al.  Tracking Many Objects Using Subordinated Condensation , 2002, BMVC.

[35]  Donald Reid.  An algorithm for tracking multiple targets , 1978 .

[36]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[37]  Margrit Betke,et al.  Efficient track linking methods for track graphs using network-flow and set-cover techniques , 2011, CVPR 2011.

[38]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.

[39]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[40]  Tyson L. Hedrick,et al.  The mechanics and behavior of cliff swallows during tandem flights , 2014, Journal of Experimental Biology.

[41]  Jason W. Horn,et al.  Economic value of the pest control service provided by Brazilian free-tailed bats in south-central Texas , 2006 .

[42]  Margrit Betke,et al.  A protocol and calibration method for accurate multi-camera field videography , 2014, Journal of Experimental Biology.

[43]  P. Perona,et al.  Visual methods for three-dimensional modeling , 1999 .

[44]  Margrit Betke,et al.  Tracking-reconstruction or reconstruction-tracking? Comparison of two multiple hypothesis tracking approaches to interpret 3D object motion from several camera views , 2009, 2009 Workshop on Motion and Video Computing (WMVC).

[45]  Jonathan Daniel Munk.  The Descent of Ant , 2011 .