On the Decoherence of Primordial Fluctuations During Inflation