Evidence against a geocentric contribution to the zodiacal light