Constraints on Lorentz Invariance Violation with Multiwavelength Polarized Astrophysical Sources