On re-acceleration, pairs and the high-energy spectrum of AGN and Galactic black hole candidates