On the decoherence of primordial fluctuations during inflation