On the Convergence of Inexact Gradient Descent with Controlled Synchronization Steps