Inverse problem robustness for multi-species mean-field spin models