How Visual is Visual Prediction