Sets that determine integer-valued polynomials