Modeling pigeon behavior using a Conditional Restricted Boltzmann Machine

In an effort to better understand the complex courtship be- haviour of pigeons, we have built a model learned from motion capture data. We employ a Conditional Restricted Boltzmann Machine (CRBM) with binary latent features and real-valued visible units. The units are conditioned on information from previous time steps to capture dynam- ics. We validate a trained model by quantifying the characteristic "head- bobbing" present in pigeons. We also show how to predict missing data by marginalizing out the hidden variables and minimizing free energy.