Identification of key factors that reduce the variability of the single photon response