Effective field theory of stochastic diffusion from gravity