Parallelization of high-dimensional single-photon quantum gates