Two Stream Networks for Self-Supervised Ego-Motion Estimation