Parallel tracks in infrared versus X-ray emission in black hole X-ray transient outbursts: a hysteresis effect?