Diffusion for weakly coupled quantum oscillators