Untangling the contributions of image charge and laser profile for optimal photoemission of high-brightness electron beams