Origin of the asymmetric orbital--lattice interactions in correlated oxide heterostructures