The effect of the early kinetic decoupling in a fermionic dark matter model