Colors and collision rates within the Kuiper belt: problems with the collisional resurfacing scenario