Wildlife@Home: Combining Crowd Sourcing and Volunteer Computing to Analyze Avian Nesting Video

New camera technology is allowing avian ecologists to perform detailed studies of avian behavior, nesting strategies and predation in areas where it was previously impossible to gather data. Unfortunately, studies have shown mechanical triggers and a variety of sensors to be inadequate in capturing footage of small predators (e.g., snakes, rodents) or events in dense vegetation. Because of this, continuous camera recording is currently the most robust solution for avian monitoring, especially in ground nesting species. However, continuous video footage results in a data deluge, as monitoring enough nests to make biologically significant inferences results in massive amounts of data which is unclassifiable by humans alone. In the summer of 2012, Dr. Ellis-Felege gathered video footage from 63 sharp-tailed grouse (Tympanuchus phasianellus) nests, as well as preliminary interior least tern (Sternula antillarum) and piping plover (Charadrius melodus) nests, resulting in over 20,000 hours of video footage. In order to effectively analyze this video, a project combining both crowd sourcing and volunteer computing was developed, where volunteers can stream nesting video and report their observations, as well as have their computers download video for analysis by computer vision techniques. This provides a robust way to analyze the video, as user observations are validated by multiple views as well as the results of the computer vision techniques. This work provides initial results analyzing the effectiveness of the crowd sourced observations and computer vision techniques.

[1]  Thomas J. Benson,et al.  Development of camera technology for monitoring nests , 2012 .

[2]  Fernando De la Torre,et al.  Computerized detection and analysis of cancer chemotherapy-induced emesis in a small animal model, musk shrew , 2011, Journal of Neuroscience Methods.

[3]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[4]  C. Lintott,et al.  Galaxy Zoo 1: data release of morphological classifications for nearly 900 000 galaxies , 2010, 1007.3265.

[5]  Carlos A. Varela,et al.  Maximum Likelihood Fitting of Tidal Streams with Application to the Sagittarius Dwarf Tidal Tails , 2008, 0805.2121.

[6]  David P. Anderson Volunteer computing , 2010, CROS.

[7]  E. Rückert Detecting Pedestrians by Learning Shapelet Features , 2007 .

[8]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[9]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Greg Mori,et al.  Machine Vision and Applications Manuscript No. Bearcam: Automated Wildlife Monitoring at the Arctic Circle , 2022 .

[11]  David P. Anderson,et al.  High-performance task distribution for volunteer computing , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[12]  T. Leroy,et al.  Automatic real-time monitoring of locomotion and posture behaviour of pregnant cows prior to calving using online image analysis , 2008 .

[13]  Christian Benjamin Ries Berkeley Open Infrastructure for Network Computing , 2012 .

[14]  Andrew Calway,et al.  Tracking Many Objects Using Subordinated Condensation , 2002, BMVC.

[15]  Rama Chellappa,et al.  Shape-and-Behavior Encoded Tracking of Bee Dances , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  R. D. Tillett,et al.  Using model-based image processing to track animal movements , 1997 .

[17]  Hiroyuki Ishii,et al.  Development of autonomous experimental setup for behavior analysis of rats , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  KhanZia,et al.  MCMC-Based Particle Filtering for Tracking a Variable Number of Interacting Targets , 2005 .

[19]  Serge J. Belongie,et al.  Behavior recognition via sparse spatio-temporal features , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[20]  Rémi Ronfard,et al.  A survey of vision-based methods for action representation, segmentation and recognition , 2011, Comput. Vis. Image Underst..

[21]  Hemerson Pistori,et al.  Multiple Mice Tracking using a Combination of Particle Filter and K-Means , 2007 .

[22]  Jeffry D Madura,et al.  Structure of aqueous sodium perchlorate solutions. , 2008, The journal of physical chemistry. B.

[23]  Frank Dellaert,et al.  MCMC-based particle filtering for tracking a variable number of interacting targets , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  F. Dellaert,et al.  A Rao-Blackwellized particle filter for EigenTracking , 2004, CVPR 2004.

[25]  Boleslaw K. Szymanski,et al.  Finding Protein Binding Sites Using Volunteer Computing Grids , 2012 .

[26]  Vijay S. Pande,et al.  Folding@home: Lessons from eight years of volunteer distributed computing , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[27]  Takeshi Takaki,et al.  High-speed video analysis of laboratory rats behaviors in forced swim test , 2008, 2008 IEEE International Conference on Automation Science and Engineering.

[28]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[29]  Juan Antonio Lopez-Perez Distributed computing and farm management with application to the search for heavy gauge bosons using the ATLAS experiment at the LHC (CERN) , 2008 .

[30]  Andreas Ernst,et al.  Fast face detection and species classification of African great apes , 2011, 2011 8th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[31]  Aly A. Farag,et al.  CSIFT: A SIFT Descriptor with Color Invariant Characteristics , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[32]  Susan N. Ellis-Felege,et al.  Gamebirds and Nest Cameras: Present and Future , 2012 .

[33]  R. Bonney,et al.  Citizen Science: A Developing Tool for Expanding Science Knowledge and Scientific Literacy , 2009 .

[34]  C. Lintott,et al.  Galaxy Zoo: morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey , 2008, 0804.4483.

[35]  Fernando De la Torre,et al.  Non-rigid tracking of musk shrews in video for detection of emetic episodes , 2011, CVPR 2011 WORKSHOPS.

[36]  N S Zefirov,et al.  Versatile computerized system for tracking and analysis of water maze tests , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[37]  Pietro Perona,et al.  High-throughput Ethomics in Large Groups of Drosophila , 2009, Nature Methods.

[38]  Serge J. Belongie,et al.  Monitoring Animal Behavior in the Smart Vivarium , 2004 .

[39]  Hemerson Pistori,et al.  Mice and larvae tracking using a particle filter with an auto-adjustable observation model , 2010, Pattern Recognit. Lett..

[40]  Andrew Steele,et al.  Trainable, vision-based automated home cage behavioral phenotyping , 2010, MB '10.

[41]  Guillaume-Alexandre Bilodeau,et al.  RAT: Robust animal tracking , 2011, 2011 IEEE International Symposium on Robotic and Sensors Environments (ROSE).

[42]  Thomas Serre,et al.  Automated home-cage behavioural phenotyping of mice. , 2010, Nature communications.

[43]  Michael H. Dickinson,et al.  TrackFly: Virtual reality for a behavioral system analysis in free-flying fruit flies , 2008, Journal of Neuroscience Methods.

[44]  Pietro Perona,et al.  Automated monitoring and analysis of social behavior in Drosophila , 2009, Nature Methods.

[45]  C. Lintott,et al.  Planet Hunters: the first two planet candidates identified by the public using the Kepler public archive data , 2011, 1109.4621.

[46]  Marc Garbey,et al.  Large scale parameter study of an individual-based model of clonal plant with volunteer computing , 2011 .

[47]  Margrit Betke,et al.  Tracking Large Variable Numbers of Objects in Clutter , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[49]  Yi Pan,et al.  Gene sequence alignment on a public computing platform , 2005, 2005 International Conference on Parallel Processing Workshops (ICPPW'05).

[50]  Idaku Ishii,et al.  Real-time scratching behavior quantification system for laboratory mice using high-speed vision , 2009, Journal of Real-Time Image Processing.

[51]  P. Fearnhead,et al.  Improved particle filter for nonlinear problems , 1999 .

[52]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[53]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[54]  Caren B. Cooper,et al.  Using a Free Online Citizen-Science Project to Teach Observation & Quantification of Animal Behavior , 2010 .

[55]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[56]  Greg Mori,et al.  Action Recognition of Insects Using Spectral Clustering , 2007, MVA.

[57]  Boleslaw K. Szymanski,et al.  Evolving N-Body Simulations to Determine the Origin and Structure of the Milky Way Galaxy's Halo Using Volunteer Computing , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.