Exceptional graphs for the random walk