Ultrafast quantum photonics enabled by coupling plasmonic nanocavities to strongly radiative antennas