Sharpening the Distance Conjecture in diverse dimensions