Single-spin polaron memory effect in quantum dots and single molecules