From Scattering in Black Hole Backgrounds to Higher-Spin Amplitudes: Part I