Approaching the true ground state of frustratedA-site spinels: A combined magnetization and polarized neutron scattering study