Memory in a Nonlocally Damped Oscillator