Amplitude hysteresis of the surface reactance of a layered superconductor