Ultrafast Defect Manipulation with Optical Anisotropy in Fused Silica