Predictive network with leveraging clinical measures as auxiliary task