Interface roughness, valley-orbit coupling, and valley manipulation in quantum dots