Construction of the Unitary Free Fermion Segal CFT