The impact of strong gravitational lensing on observed Lyman-break galaxy numbers at 4 ≤ z ≤ 8 in the GOODS and the XDF blank fields