Is Graph Structure Necessary for Multi-hop Question Answering?