Learning to Play Hard Exploration Games Using Graph-Guided Self-Navigation