Oracle lower bounds for stochastic gradient sampling algorithms