A Brownian Ball Interacting with Infinitely Many Brownian Particles in $\mathbf{R}^d$