Less space for a new family of fermions