Invariant and Dual Invariant Subspaces of $k$-valued Networks