On-line learning in a discrete state space