A Foundation for Markoiv Equilibria in Infinite Horizon Perfect Information Games