Beyond Flux-limited Diffusion: Parallel Algorithms for Multidimensional Radiation Hydrodynamics