Do We Really Need Complicated Model Architectures For Temporal Networks?