On the $\mu$-invariant of $Z$-homology 3-spheres