Observer memories may not be for everyone