CROSS-CORRELATION OF NEAR- AND FAR-INFRARED BACKGROUND ANISOTROPIES AS TRACED BY SPITZER AND HERSCHEL