Delayed Babcock-Leighton dynamos in the diffusion-dominated regime