Bubble expansion and the viability of singlet-driven electroweak baryogenesis