A depth-map approach for automatic mice behavior recognition

Animal behavior assessment plays an important role in basic and clinical neuroscience. Although assessing the higher functional level of the nervous system is already possible, behavioral tests are extremely complex to design and analyze. Animal's responses are often evaluated manually, making it subjective, extremely time consuming, poorly reproducible and potentially fallible. The main goal of the present work is to evaluate the use of consumer depth cameras, such as the Microsoft's Kinect, for detection of behavioral patterns of mice. The hypothesis is that the depth information, should enable a more feasible and robust method for automatic behavior recognition. Thus, we introduce our depth-map based approach comprising mouse segmentation, body-like per-frame feature extraction and per-frame classification given temporal context, to prove the usability of this methodology.

[1]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[2]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[3]  Pietro Perona,et al.  Social behavior recognition in continuous video , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  John F. Cryan,et al.  Model organisms: The ascent of mouse: advances in modelling human depression and anxiety , 2005, Nature Reviews Drug Discovery.

[5]  L. de Visser,et al.  Novel approach to the behavioural characterization of inbred mice: automated home cage observations , 2006, Genes, brain, and behavior.

[6]  S. Stanford The Open Field Test: reinventing the wheel , 2007, Journal of psychopharmacology.

[7]  Thomas Serre,et al.  Automated home-cage behavioural phenotyping of mice. , 2010, Nature communications.

[8]  Daniel Herrera C,et al.  Joint depth and color camera calibration with distortion correction. , 2012, IEEE transactions on pattern analysis and machine intelligence.

[9]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[10]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[11]  Zhengyou Zhang,et al.  Calibration between depth and color sensors for commodity depth cameras , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[12]  Rémi Ronfard,et al.  A survey of vision-based methods for action representation, segmentation and recognition , 2011, Comput. Vis. Image Underst..

[13]  Ventseslav Sainov,et al.  3-D Time-Varying Scene Capture Technologies—A Survey , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Jaime S. Cardoso,et al.  A 3D low-cost solution for the aesthetic evaluation of breast cancer conservative treatment , 2014, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[15]  Paulo Aguiar,et al.  OpenControl: A free opensource software for video tracking and automated control of behavioral mazes , 2007, Journal of Neuroscience Methods.

[16]  E. Lander Initial impact of the sequencing of the human genome , 2011, Nature.