Quantum decoherence of a charge qubit in a spin-fermion model