Harnessing spectral phase in broadband time-energy entangled photons for precision delay sensing