We provide experimental evidence that adding links to a network's structure can hinder synchronization. Our experiments and theoretical analysis of networks of time-delayed optoelectronic oscillators uncover the scenario of loss of identical synchronization upon connectivity modifications. This counterintuitive loss of synchronization can occur even when the network structure is improved from a connectivity perspective. Utilizing a master stability function approach, we show that a time delay in the coupling of nodes plays a crucial role in determining a network's synchronization properties and that this effect is more prominent in directed networks than in undirected networks, especially for large networks. Our results provide insight into the impact of structural modifications in networks with equal coupling delays and open the path to design changes to the network connectivity to sustain and control the performance of real-world networks.