Principal submatrices III: Linear inequalities