Active Galactic Nucleus Ghosts: A Systematic Search for Faded Nuclei