Totally Variant Sets in Finite Groups and Vector Spaces