The early instability scenario: Terrestrial planet formation during the giant planet instability, and the effect of collisional fragmentation