Limit distribution theory for smooth $p$-Wasserstein distances