Large-population limits of non-exchangeable particle systems