Rapid mass segregation in young star clusters without substructure?