Robustness of the far-field response of nonlocal plasmonic ensembles