Parity-time symmetric systems with memory