Breaking down the link between luminous and dark matter in massive galaxies