Lifting matrix units in $C^*$-algebras II.