• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

贝叶斯因子调整的稀疏回归

Bayesian Factor-adjusted Sparse Regression.

作者信息

Fan Jianqing, Jiang Bai, Sun Qiang

机构信息

Department of Operations Research and Financial Engineering, Princeton University, Princeton, NJ 08544.

Department of Statistical Sciences, University of Toronto, Toronto, ON M5S 3G3.

出版信息

J Econom. 2022 Sep;230(1):3-19. doi: 10.1016/j.jeconom.2020.06.012. Epub 2021 Nov 1.

DOI:10.1016/j.jeconom.2020.06.012
PMID:35754940
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9223477/
Abstract

Many sparse regression methods are based on the assumption that covariates are weakly correlated, which unfortunately do not hold in many economic and financial datasets. To address this challenge, we model the strongly-correlated covariates by a factor structure: strong correlations among covariates are explained by common factors and the remaining variations are interpreted as idiosyncratic components. We then propose a factor-adjusted sparse regression model with both common factors and idiosyncratic components as decorrelated covariates and develop a semi-Bayesian method. Parameter estimation rate-optimality and model selection consistency are established by non-asymptotic analyses. We show on simulated data that the semi-Bayesian method outperforms its Lasso analogue, manifests insensitivity to the overestimates of the number of common factors, pays a negligible price when covariates are not correlated, scales up well with increasing sample size, dimensionality and sparsity, and converges fast to the equilibrium of the posterior distribution. Numerical results on a real dataset of U.S. bond risk premia and macroeconomic indicators also lend strong supports to the proposed method.

摘要

许多稀疏回归方法基于协变量弱相关的假设,但遗憾的是,这一假设在许多经济和金融数据集中并不成立。为应对这一挑战,我们通过因子结构对强相关协变量进行建模:协变量之间的强相关性由公共因子解释,其余变化则被解释为特质成分。然后,我们提出一种因子调整的稀疏回归模型,将公共因子和特质成分都作为去相关的协变量,并开发了一种半贝叶斯方法。通过非渐近分析建立了参数估计的速率最优性和模型选择的一致性。我们在模拟数据上表明,半贝叶斯方法优于其Lasso类似方法,对公共因子数量的高估不敏感,在协变量不相关时代价可忽略不计,随着样本量、维度和稀疏性的增加扩展性良好,并且能快速收敛到后验分布的均衡状态。关于美国债券风险溢价和宏观经济指标的真实数据集的数值结果也为所提出的方法提供了有力支持。

相似文献

1
Bayesian Factor-adjusted Sparse Regression.贝叶斯因子调整的稀疏回归
J Econom. 2022 Sep;230(1):3-19. doi: 10.1016/j.jeconom.2020.06.012. Epub 2021 Nov 1.
2
Factor-Adjusted Regularized Model Selection.因子调整正则化模型选择
J Econom. 2020 May;216(1):71-85. doi: 10.1016/j.jeconom.2020.01.006. Epub 2020 Feb 7.
3
Bayesian Bridge Regression.贝叶斯桥式回归
J Appl Stat. 2018;45(6):988-1008. doi: 10.1080/02664763.2017.1324565. Epub 2017 May 10.
4
Bayesian sparse reduced rank multivariate regression.贝叶斯稀疏降秩多元回归
J Multivar Anal. 2017 May;157:14-28. doi: 10.1016/j.jmva.2017.02.007. Epub 2017 Mar 4.
5
The lasso for high dimensional regression with a possible change point.具有可能变化点的高维回归套索法
J R Stat Soc Series B Stat Methodol. 2016 Jan;78(1):193-210. doi: 10.1111/rssb.12108. Epub 2015 Feb 15.
6
Variable Selection for Sparse High-Dimensional Nonlinear Regression Models by Combining Nonnegative Garrote and Sure Independence Screening.结合非负Garrote和确定独立筛选法的稀疏高维非线性回归模型的变量选择
Stat Sin. 2014 Jul;24(3):1365-1387. doi: 10.5705/ss.2012.316.
7
Variable Selection for High-dimensional Nodal Attributes in Social Networks with Degree Heterogeneity.具有度异质性的社交网络中高维节点属性的变量选择
J Am Stat Assoc. 2024;119(546):1322-1335. doi: 10.1080/01621459.2023.2187815. Epub 2023 Apr 13.
8
Sparse Multivariate Regression With Covariance Estimation.带协方差估计的稀疏多元回归
J Comput Graph Stat. 2010 Fall;19(4):947-962. doi: 10.1198/jcgs.2010.09188.
9
Assessment and statistical modeling of the relationship between remotely sensed aerosol optical depth and PM2.5 in the eastern United States.美国东部地区遥感气溶胶光学厚度与PM2.5之间关系的评估及统计建模
Res Rep Health Eff Inst. 2012 May(167):5-83; discussion 85-91.
10
Sparse Bayesian Learning With Weakly Informative Hyperprior and Extended Predictive Information Criterion.具有弱信息超先验和扩展预测信息准则的稀疏贝叶斯学习
IEEE Trans Neural Netw Learn Syst. 2023 Sep;34(9):5856-5868. doi: 10.1109/TNNLS.2021.3131357. Epub 2023 Sep 1.

本文引用的文献

1
Adaptive Huber Regression on Markov-dependent Data.基于马尔可夫相关数据的自适应Huber回归
Stoch Process Their Appl. 2022 Aug;150:802-818. doi: 10.1016/j.spa.2019.09.004. Epub 2019 Sep 25.
2
Robust high dimensional factor models with applications to statistical machine learning.具有统计机器学习应用的稳健高维因子模型。
Stat Sci. 2021 May;36(2):303-327. doi: 10.1214/20-sts785. Epub 2021 Apr 19.
3
Factor-Adjusted Regularized Model Selection.因子调整正则化模型选择
J Econom. 2020 May;216(1):71-85. doi: 10.1016/j.jeconom.2020.01.006. Epub 2020 Feb 7.
4
I-LAMM FOR SPARSE LEARNING: SIMULTANEOUS CONTROL OF ALGORITHMIC COMPLEXITY AND STATISTICAL ERROR.用于稀疏学习的I-LAMM:算法复杂度与统计误差的同时控制
Ann Stat. 2018 Apr;46(2):814-841. doi: 10.1214/17-AOS1568. Epub 2018 Apr 3.
5
Asymptotics of empirical eigenstructure for high dimensional spiked covariance.高维尖峰协方差的经验特征结构渐近性
Ann Stat. 2017 Jun;45(3):1342-1374. doi: 10.1214/16-AOS1487. Epub 2017 Jun 13.
6
Dirichlet-Laplace priors for optimal shrinkage.用于最优收缩的狄利克雷-拉普拉斯先验
J Am Stat Assoc. 2015 Dec 1;110(512):1479-1490. doi: 10.1080/01621459.2014.960967. Epub 2014 Sep 25.
7
GENERALIZED DOUBLE PARETO SHRINKAGE.广义双帕累托收缩
Stat Sin. 2013 Jan 1;23(1):119-143.
8
Large Covariance Estimation by Thresholding Principal Orthogonal Complements.通过阈值化主正交补进行大协方差估计
J R Stat Soc Series B Stat Methodol. 2013 Sep 1;75(4). doi: 10.1111/rssb.12016.
9
HIGH DIMENSIONAL COVARIANCE MATRIX ESTIMATION IN APPROXIMATE FACTOR MODELS.近似因子模型中的高维协方差矩阵估计
Ann Stat. 2011 Jan 1;39(6):3320-3356. doi: 10.1214/11-AOS944.
10
Sparse High Dimensional Models in Economics.经济学中的稀疏高维模型。
Annu Rev Econom. 2011 Sep;3:291-317. doi: 10.1146/annurev-economics-061109-080451.