JAABA: interactive machine learning for automatic annotation of animal behavior

We present a machine learning–based system for automatically computing interpretable, quantitative measures of animal behavior. Through our interactive system, users encode their intuition about behavior by annotating a small set of video frames. These manual labels are converted into classifiers that can automatically annotate behaviors in screen-scale data sets. Our general-purpose system can create a variety of accurate individual and social behavior classifiers for different organisms, including mice and adult and larval Drosophila.

[1]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[2]  Jean-René Martin A portrait of locomotor behaviour in Drosophila determined by a video-tracking paradigm , 2004, Behavioural Processes.

[3]  G. Rubin,et al.  Tools for neuroanatomy and neurogenetics in Drosophila , 2008, Proceedings of the National Academy of Sciences.

[4]  Pietro Perona,et al.  Automated monitoring and analysis of social behavior in Drosophila , 2009, Nature Methods.

[5]  Pietro Perona,et al.  High-throughput Ethomics in Large Groups of Drosophila , 2009, Nature Methods.

[6]  Aravinthan D. T. Samuel,et al.  Navigational Decision Making in Drosophila Thermotaxis , 2010, The Journal of Neuroscience.

[7]  M. Dickinson,et al.  A New Chamber for Studying the Behavior of Drosophila , 2010, PloS one.

[8]  M. Dickinson,et al.  Object preference by walking fruit flies, Drosophila melanogaster, is mediated by vision and graviperception , 2010, Journal of Experimental Biology.

[9]  A. Gomez-Marin,et al.  Active sampling and decision making in Drosophila chemotaxis , 2011, Nature communications.

[10]  Rex A. Kerr,et al.  High-Throughput Behavioral Analysis in C. elegans , 2011, Nature Methods.

[11]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[12]  A. Cressant,et al.  Computerized video analysis of social interactions in mice , 2012, Nature Methods.

[13]  Julie H. Simpson,et al.  A GAL4-driver line resource for Drosophila neurobiology. , 2012, Cell reports.