Quantum phase modulation with acoustic cavities and quantum dots