Dust Grain Size Distributions and the Abundance of Refractory Elements in the Diffuse Interstellar Medium