A polynomial action on colored sl(2) link homology