Primal-dual subgradient methods for minimizing uniformly convex functions

Anatoli B. Juditsky (1) , Yuri Nesterov (2)

1 SMS - Statistique et Modélisation Stochatisque
2 CORE - Center of Operation Research and Econometrics [Louvain]

We discuss non-Euclidean deterministic and stochastic algorithms for optimization problems with strongly and uniformly convex objectives. We provide accuracy bounds for the performance of these algorithms and design methods which are adaptive with respect to the parameters of strong or uniform convexity of the objective: in the case when the total number of iterations $N$ is fixed, their accuracy coincides, up to a logarithmic in $N$ factor with the accuracy of optimal algorithms.

Keywords: Uniformly convex optimization; Non-Euclidean first order algorithms; Large scale stochastic approximation

Domains: Optimization and Control [math.OC]

Anatoli B. Juditsky, Yuri Nesterov. Primal-dual subgradient methods for minimizing uniformly convex functions. 2010. ⟨hal-00508933v3⟩