Sun Wei, Wang Zhaoran, Liu Han, Cheng Guang
Yahoo Labs, Sunnyvale, CA.
Department of Operations Research, and Financial Engineering, Princeton University, Princeton, NJ.
Adv Neural Inf Process Syst. 2015;28:1081-1089.
We consider the estimation of sparse graphical models that characterize the dependency structure of high-dimensional tensor-valued data. To facilitate the estimation of the precision matrix corresponding to each way of the tensor, we assume the data follow a tensor normal distribution whose covariance has a Kronecker product structure. The penalized maximum likelihood estimation of this model involves minimizing a non-convex objective function. In spite of the non-convexity of this estimation problem, we prove that an alternating minimization algorithm, which iteratively estimates each sparse precision matrix while fixing the others, attains an estimator with the optimal statistical rate of convergence as well as consistent graph recovery. Notably, such an estimator achieves estimation consistency with only one tensor sample, which is unobserved in previous work. Our theoretical results are backed by thorough numerical studies.
我们考虑对稀疏图形模型进行估计,该模型刻画了高维张量值数据的依赖结构。为便于估计与张量的每种方式相对应的精度矩阵,我们假设数据服从协方差具有克罗内克积结构的张量正态分布。此模型的惩罚最大似然估计涉及最小化一个非凸目标函数。尽管该估计问题具有非凸性,但我们证明了一种交替最小化算法,即在固定其他矩阵的同时迭代估计每个稀疏精度矩阵,能得到具有最优统计收敛速率以及一致图恢复的估计器。值得注意的是,这样的估计器仅用一个张量样本就能实现估计一致性,这在先前的工作中是未被观察到的。我们的理论结果得到了全面数值研究的支持。