Fixed point sets for permutation modules