On the normalizer property for integral group rings