Inverse iteration for $p$-ground states