Quantitative assessment of mean-field modeling for athermally sheared yield stress materials