Hints of integrability beyond the planar limit: nontrivial backgrounds