Physical origins of time asymmetry