Suppr超能文献

用于稀疏张量图形模型的非凸统计优化

Non-convex Statistical Optimization for Sparse Tensor Graphical Model.

作者信息

Sun Wei, Wang Zhaoran, Liu Han, Cheng Guang

机构信息

Yahoo Labs, Sunnyvale, CA.

Department of Operations Research, and Financial Engineering, Princeton University, Princeton, NJ.

出版信息

Adv Neural Inf Process Syst. 2015;28:1081-1089.

Abstract

We consider the estimation of sparse graphical models that characterize the dependency structure of high-dimensional tensor-valued data. To facilitate the estimation of the precision matrix corresponding to each way of the tensor, we assume the data follow a tensor normal distribution whose covariance has a Kronecker product structure. The penalized maximum likelihood estimation of this model involves minimizing a non-convex objective function. In spite of the non-convexity of this estimation problem, we prove that an alternating minimization algorithm, which iteratively estimates each sparse precision matrix while fixing the others, attains an estimator with the optimal statistical rate of convergence as well as consistent graph recovery. Notably, such an estimator achieves estimation consistency with only one tensor sample, which is unobserved in previous work. Our theoretical results are backed by thorough numerical studies.

摘要

我们考虑对稀疏图形模型进行估计,该模型刻画了高维张量值数据的依赖结构。为便于估计与张量的每种方式相对应的精度矩阵,我们假设数据服从协方差具有克罗内克积结构的张量正态分布。此模型的惩罚最大似然估计涉及最小化一个非凸目标函数。尽管该估计问题具有非凸性,但我们证明了一种交替最小化算法,即在固定其他矩阵的同时迭代估计每个稀疏精度矩阵,能得到具有最优统计收敛速率以及一致图恢复的估计器。值得注意的是,这样的估计器仅用一个张量样本就能实现估计一致性,这在先前的工作中是未被观察到的。我们的理论结果得到了全面数值研究的支持。

相似文献

2
Tensor Graphical Model: Non-Convex Optimization and Statistical Inference.张量图形模型:非凸优化与统计推断
IEEE Trans Pattern Anal Mach Intell. 2020 Aug;42(8):2024-2037. doi: 10.1109/TPAMI.2019.2907679. Epub 2019 Mar 26.
4
6
Sparse estimation of a covariance matrix.协方差矩阵的稀疏估计。
Biometrika. 2011 Dec;98(4):807-820. doi: 10.1093/biomet/asr054.
7
SMURC: High-Dimension Small-Sample Multivariate Regression With Covariance Estimation.SMURC:带协方差估计的高维小样本多元回归
IEEE J Biomed Health Inform. 2017 Mar;21(2):573-581. doi: 10.1109/JBHI.2016.2515993. Epub 2016 Jan 8.
10
Convex Banding of the Covariance Matrix.协方差矩阵的凸带形
J Am Stat Assoc. 2016;111(514):834-845. doi: 10.1080/01621459.2015.1058265. Epub 2016 Aug 18.

引用本文的文献

1

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验