Additive decompositions of sets with restricted prime factors