A Unified Encoder-Decoder Framework with Entity Memory