Black widow pulsars: the price of promiscuity