The Direct Method for A Class of Infinite Horizon Dynamic Games