Mean Estimation with User-level Privacy under Data Heterogeneity