Cumulative physical uncertainty in modern stellar models. II. The dependence on the chemical composition