Pure Dephasing of Light-Matter Systems in the Ultrastrong and Deep-Strong Coupling Regimes