The unconventional role of surface ligands in dictating the light harvesting properties of quantum dots