A note on groups with countable automorphism groups