Chen Yuxin, Fan Jianqing, Wang Bingyan, Yan Yuling
Department of Electrical and Computer Engineering, Princeton University.
Department of Operations Research and Financial Engineering, Princeton University.
J Am Stat Assoc. 2023;118(542):858-868. doi: 10.1080/01621459.2021.1956501. Epub 2021 Sep 24.
We investigate the effectiveness of convex relaxation and nonconvex optimization in solving bilinear systems of equations under two different designs (i.e. a sort of random Fourier design and Gaussian design). Despite the wide applicability, the theoretical understanding about these two paradigms remains largely inadequate in the presence of random noise. The current paper makes two contributions by demonstrating that: (1) a two-stage nonconvex algorithm attains minimax-optimal accuracy within a logarithmic number of iterations, and (2) convex relaxation also achieves minimax-optimal statistical accuracy vis-à-vis random noise. Both results significantly improve upon the state-of-the-art theoretical guarantees.
我们研究了凸松弛和非凸优化在两种不同设计(即一种随机傅里叶设计和高斯设计)下求解双线性方程组的有效性。尽管具有广泛的适用性,但在存在随机噪声的情况下,对这两种范式的理论理解仍然非常不足。本文通过证明以下两点做出了两项贡献:(1)一种两阶段非凸算法在对数次数的迭代内达到极小极大最优精度,以及(2)相对于随机噪声,凸松弛也实现了极小极大最优统计精度。这两个结果都显著改进了当前的理论保证。