How is emotion change reflected in manual and automatic annotations of different modalities