Loss of locality in gravitational correlators with a large number of insertions