Typical versus average helicity modulus in the three-dimensional gauge glass: Understanding the vortex glass phase