Convergence Rate of Incremental Gradient and Incremental Newton Methods

The incremental gradient (IG) method is a prominent algorithm for minimizing a finite sum of smooth convex functions and is used in many contexts including large-scale data processing applications ...