SepNet: A neural network for directionally correlated data