Bulk FinFETs with body spacers for improving fin height variation