Fixed Point Varieties on the Space of Lattices