Scattering Phase Asymptotics with Fractal Remainders