Correlation structure of intermittency in the parabolic Anderson model