Improving Natural Language Understanding with Computation-Efficient Retrieval Representation Fusion