Degradation of a quantum directional reference frame as a random walk