Energy-dependent angular shifts in the photoelectron momentum distribution for atoms in elliptically polarized laser pulses