Defect-mediated creep of structured materials