Time-frequency shift invariance of Gabor spaces generated by integer lattices