On groups where the twisted conjugacy class of the unit element is a subgroup