X-Ray Halos and Large Grains in the Diffuse Interstellar Medium