The infrared polarization of NGC 1275, NGC 4151, Markarian 231, and 3C 273