Inferring dark matter substructure with global astrometry beyond the power spectrum