Diffusion-Coefficient Power Laws and Defect-Driven Glassy Dynamics in Swap Acceleration