Implication of the Hubble tension for the primordial Universe in light of recent cosmological data