Predicting the effects of kinetic impactors on asteroid deflection using end-to-end deep learning