Sign changes of the Hall coefficient in Sr$_2$RuO$_4$ reveal coherent-to-incoherent and elastic-to-inelastic crossovers