Universal suppression of superfluid weight by non-magnetic disorder in $s$-wave superconductors independent of quantum geometry and band dispersion