$p$-primary components of homotopy groups II. mod $p$ Hopf invariant