Tailored unidirectional spectral responses generated by an asymmetric plasmonic cavity