Learning to recognize rat social behavior: Novel dataset and cross-dataset application

BACKGROUND Social behavior is an important aspect of rodent models. Automated measuring tools that make use of video analysis and machine learning are an increasingly attractive alternative to manual annotation. Because machine learning-based methods need to be trained, it is important that they are validated using data from different experiment settings. NEW METHOD To develop and validate automated measuring tools, there is a need for annotated rodent interaction datasets. Currently, the availability of such datasets is limited to two mouse datasets. We introduce the first, publicly available rat social interaction dataset, RatSI. RESULTS We demonstrate the practical value of the novel dataset by using it as the training set for a rat interaction recognition method. We show that behavior variations induced by the experiment setting can lead to reduced performance, which illustrates the importance of cross-dataset validation. Consequently, we add a simple adaptation step to our method and improve the recognition performance. COMPARISON WITH EXISTING METHODS Most existing methods are trained and evaluated in one experimental setting, which limits the predictive power of the evaluation to that particular setting. We demonstrate that cross-dataset experiments provide more insight in the performance of classifiers. CONCLUSIONS With our novel, public dataset we encourage the development and validation of automated recognition methods. We are convinced that cross-dataset validation enhances our understanding of rodent interactions and facilitates the development of more sophisticated recognition methods. Combining them with adaptation techniques may enable us to apply automated recognition methods to a variety of animals and experiment settings.

[1]  Olaf Riess,et al.  Neurobehavioral tests in rat models of degenerative brain diseases. , 2010, Methods in molecular biology.

[2]  David J. Anderson,et al.  Automated measurement of mouse social behaviors using depth sensing, video tracking, and machine learning , 2015, Proceedings of the National Academy of Sciences.

[3]  Pietro Perona,et al.  Automated image-based tracking and its application in ecology. , 2014, Trends in ecology & evolution.

[4]  A. Cools,et al.  The role of the dopamine D1 receptor in social cognition: studies using a novel genetic rat model , 2016, Disease Models & Mechanisms.

[5]  Jennie R. Green,et al.  Loss of MeCP2 in the rat models regression, impaired sociability and transcriptional deficits of Rett syndrome , 2016, Human molecular genetics.

[6]  L P Noldus,et al.  EthoVision: A versatile video tracking system for automation of behavioral experiments , 2001, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[7]  Thomas Serre,et al.  An end-to-end generative framework for video segmentation and recognition , 2015, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[8]  O. Riess,et al.  Automated phenotyping and advanced data mining exemplified in rats transgenic for Huntington's disease , 2014, Journal of Neuroscience Methods.

[9]  Berry M. Spruijt,et al.  Approach, avoidance, and contact behavior of individually recognized animals automatically quantified with an imaging technique , 1992, Physiology & Behavior.

[10]  F. Hamprecht,et al.  Detecting individual body parts improves mouse behavior classification , 2014 .

[11]  S. File,et al.  A review of 25 years of the social interaction test. , 2003, European journal of pharmacology.

[12]  Antonio Krüger,et al.  Behavioral phenotyping of a murine model of Alzheimer’s disease in a seminaturalistic environment using RFID tracking , 2009, Behavior research methods.

[13]  Christina A. Wilson,et al.  Social interaction and social withdrawal in rodents as readouts for investigating the negative symptoms of schizophrenia , 2014, European Neuropsychopharmacology.

[14]  J. Schneider,et al.  Automated identification of social interaction criteria in Drosophila melanogaster , 2014, Biology Letters.

[15]  Vittorio Murino,et al.  Automatic Visual Tracking and Social Behaviour Analysis with Multiple Mice , 2013, PloS one.

[16]  C. Calaminus,et al.  A Novel Transgenic Rat Model for Spinocerebellar Ataxia Type 17 Recapitulates Neuropathological Changes and Supplies In Vivo Imaging Biomarkers , 2013, The Journal of Neuroscience.

[17]  Kristin Branson,et al.  Machine vision methods for analyzing social interactions , 2017, Journal of Experimental Biology.

[18]  C. Braak,et al.  An automated system for the recognition of various specific rat behaviours , 2013, Journal of Neuroscience Methods.

[19]  Elisavet I. Kyriakou,et al.  Automated quantitative analysis to assess motor function in different rat models of impaired coordination and ataxia , 2016, Journal of Neuroscience Methods.

[20]  Claire Richardson,et al.  The power of automated behavioural homecage technologies in characterizing disease progression in laboratory mice: A review , 2015 .

[21]  I. J. Pinter,et al.  Novel approach to automatically classify rat social behavior using a video tracking system , 2016, Journal of Neuroscience Methods.

[22]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[23]  Kristin Branson,et al.  Computational Analysis of Behavior. , 2016, Annual review of neuroscience.

[24]  Pietro Perona,et al.  Social behavior recognition in continuous video , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  F. Sams-Dodd,et al.  Automation of the social interaction test by a video-tracking system: behavioural effects of repeated phencyclidine treatment , 1995, Journal of Neuroscience Methods.

[26]  A. Pérez-Escudero,et al.  idTracker: tracking individuals in a group by automatic identification of unmarked animals , 2014, Nature Methods.

[27]  B. Spruijt,et al.  Ethological concepts enhance the translational value of animal models. , 2015, European journal of pharmacology.

[28]  S. Helene Richter,et al.  Environmental standardization: cure or cause of poor reproducibility in animal experiments? , 2009, Nature Methods.

[29]  Kristin Branson,et al.  JAABA: interactive machine learning for automatic annotation of animal behavior , 2013, Nature Methods.

[30]  J. Crabbe,et al.  Genetics of mouse behavior: interactions with laboratory environment. , 1999, Science.

[31]  Jonathan Schor,et al.  Detecting Social Actions of Fruit Flies , 2014, ECCV.

[32]  Remco C. Veltkamp,et al.  Automated Recognition of Social Behavior in Rats: The Role of Feature Quality , 2015, ICIAP.

[33]  Adam Claridge‐Chang,et al.  The surveillance state of behavioral automation , 2012, Current Opinion in Neurobiology.

[34]  Andrew D. Steele,et al.  The power of automated high-resolution behavior analysis revealed by its application to mouse models of Huntington's and prion diseases , 2007, Proceedings of the National Academy of Sciences.