A Connection between Finite- and Infinite-player Games