The matter spectral density from lensed CMB observations