Finite Deformation of Materials with an Ensemble of Defects