Strong Phase Modulation of Single Photons with Surface Acoustic Wave Cavities