On the smoothness of H\"older-doubling measures