"cs.DC"

ZeroSARAH: Efficient Nonconvex Finite-Sum Optimization with Zero Full Gradient Computation

We propose ZeroSARAH -- a novel variant of the variance-reduced method SARAH (Nguyen et al., 2017) -- for minimizing the average of a large number of nonconvex functions $\frac 1 n \sum_{i=1}^n f_i(x)$. To the best of our knowledge, in this nonconvex …