Response of incompressible fractional quantum Hall states to magnetic and non-magnetic impurities