Metal Adsorbate-Induced Plasmon Damping in Gold Nanorods: The Difference Between Metals