Automated Tracking of Whiskers in Videos of Head Fixed Rodents

We have developed software for fully automated tracking of vibrissae (whiskers) in high-speed videos (>500 Hz) of head-fixed, behaving rodents trimmed to a single row of whiskers. Performance was assessed against a manually curated dataset consisting of 1.32 million video frames comprising 4.5 million whisker traces. The current implementation detects whiskers with a recall of 99.998% and identifies individual whiskers with 99.997% accuracy. The average processing rate for these images was 8 Mpx/s/cpu (2.6 GHz Intel Core2, 2 GB RAM). This translates to 35 processed frames per second for a 640 px×352 px video of 4 whiskers. The speed and accuracy achieved enables quantitative behavioral studies where the analysis of millions of video frames is required. We used the software to analyze the evolving whisking strategies as mice learned a whisker-based detection task over the course of 6 days (8148 trials, 25 million frames) and measure the forces at the sensory follicle that most underlie haptic perception.

[1]  Nathan G. Clack,et al.  Vibrissa-Based Object Localization in Head-Fixed Mice , 2010, The Journal of Neuroscience.

[2]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  D. Simons,et al.  Biometric analyses of vibrissal tactile discrimination in the rat , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  Tomaso A. Poggio,et al.  On Edge Detection , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Per Magne Knutsen,et al.  Haptic Object Localization in the Vibrissal System: Behavior and Performance , 2006, The Journal of Neuroscience.

[6]  B. Sakmann,et al.  Unsupervised whisker tracking in unrestrained behaving animals. , 2008, Journal of neurophysiology.

[7]  Dori Derdikman,et al.  Tracking whisker and head movements in unrestrained behaving rodents. , 2005, Journal of neurophysiology.

[8]  J. Simon Wiegert,et al.  Multiple dynamic representations in the motor cortex during sensorimotor learning , 2012, Nature.

[9]  D. Kleinfeld,et al.  'Where' and 'what' in the whisker sensorimotor system , 2008, Nature Reviews Neuroscience.

[10]  Andrej Kosir,et al.  Unsupervised quantification of whisking and head movement in freely moving rodents. , 2011, Journal of neurophysiology.

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[12]  M. Andermann,et al.  Embodied Information Processing: Vibrissa Mechanics and Texture Features Shape Micromotions in Actively Sensing Rats , 2008, Neuron.

[13]  R Bermejo,et al.  Discriminative whisking in the head-fixed rat: optoelectronic monitoring during tactile detection and discrimination tasks. , 2001, Somatosensory & motor research.

[14]  Jason Wolfe,et al.  Sparse temporal coding of elementary tactile features during active whisker sensation , 2009, Nature Neuroscience.

[15]  D. Kleinfeld,et al.  Active Spatial Perception in the Vibrissa Scanning Sensorimotor System , 2007, PLoS biology.

[16]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jose M. Carmena,et al.  A System for Neural Recording and Closed-Loop Intracortical Microstimulation in Awake Rodents , 2009, IEEE Transactions on Biomedical Engineering.

[18]  Joseph H. Solomon,et al.  Biomechanical models for radial distance determination by the rat vibrissal system. , 2007, Journal of neurophysiology.

[19]  Ben Mitchinson,et al.  Feedback control in active sensing: rat exploratory whisking is modulated by environmental contact , 2007, Proceedings of the Royal Society B: Biological Sciences.

[20]  M. Diamond,et al.  Neuronal Activity in Rat Barrel Cortex Underlying Texture Discrimination , 2007, PLoS biology.

[21]  Daniel N. Hill,et al.  Biomechanics of the Vibrissa Motor Plant in Rat: Rhythmic Whisking Consists of Triphasic Neuromuscular Activity , 2008, The Journal of Neuroscience.

[22]  T. Prescott,et al.  An Algorithm for Automatic Tracking of Rat Whiskers , 2010 .