Approximating high-dimensional infinite-order $U$-statistics: Statistical and computational guarantees