Improving Anomaly Segmentation with Multi-Granularity Cross-Domain Alignment