Inverses of Rank Invariant Powers of a Matrix