Variations in stability revealed by temporal asymmetries in contraction of phase space flow