The dependence of the hole spectrum on spin frustration and direct hopping in the two-band Hubbard model