Magnetic and defect probes of the SmB6 surface state