Anomalous spectral response of plasmon-exciton strong coupling beyond J-C model