Deep learning on mixed frequency data