The equilibrium view on dust and metals in galaxies: Galactic outflows drive low dust-to-metal ratios in dwarf galaxies