Gravitational wave constraints on the shape of neutron stars