The Fall of Active Galactic Nuclei and the Rise of Star-forming Galaxies: A Close Look at the Chandra Deep Field X-Ray Number Counts