Coupling localized plasmonic and photonic modes tailors and boosts ultrafast light modulation by gold nanoparticles.