The simplest massive S-matrix: from minimal coupling to black holes