Thermodynamic bound on the asymmetry of cross-correlations