Two Years of Nonthermal Emission from the Binary Neutron Star Merger GW170817: Rapid Fading of the Jet Afterglow and First Constraints on the Kilonova Fastest Ejecta