Extra phase noise from thermal fluctuations in non-linear optical crystals