Fractal nature of high-order time crystal phases