Sequentially Swapping Colored Tokens on Graphs