Non-equilibrium dynamics of a simple stochastic model