Fermion determinants in matrix models of QCD at nonzero chemical potential