• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

潜在因子回归和稀疏回归是否足够?

Are Latent Factor Regression and Sparse Regression Adequate?

作者信息

Fan Jianqing, Lou Zhipeng, Yu Mengxin

机构信息

Frederick L. Moore '18 Professor of Finance, Professor of Statistics, and Professor of Operations Research and Financial Engineering at the Princeton University.

Department of Operations Research and Financial Engineering, Princeton University.

出版信息

J Am Stat Assoc. 2024;119(546):1076-1088. doi: 10.1080/01621459.2023.2169700. Epub 2023 Feb 14.

DOI:10.1080/01621459.2023.2169700
PMID:39268549
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11390100/
Abstract

We propose the Factor Augmented (sparse linear) Regression Model (FARM) that not only admits both the latent factor regression and sparse linear regression as special cases but also bridges dimension reduction and sparse regression together. We provide theoretical guarantees for the estimation of our model under the existence of sub-Gaussian and heavy-tailed noises (with bounded (1 + ) -th moment, for all > 0) respectively. In addition, the existing works on supervised learning often assume the latent factor regression or sparse linear regression is the true underlying model without justifying its adequacy. To fill in such an important gap on high-dimensional inference, we also leverage our model as the alternative model to test the sufficiency of the latent factor regression and the sparse linear regression models. To accomplish these goals, we propose the Factor-Adjusted deBiased Test (FabTest) and a two-stage ANOVA type test respectively. We also conduct large-scale numerical experiments including both synthetic and FRED macroeconomics data to corroborate the theoretical properties of our methods. Numerical results illustrate the robustness and effectiveness of our model against latent factor regression and sparse linear regression models.

摘要

我们提出了因子增强(稀疏线性)回归模型(FARM),该模型不仅将潜在因子回归和稀疏线性回归作为特殊情况包含在内,还将降维和稀疏回归联系在一起。我们分别在次高斯噪声和重尾噪声(对于所有(\epsilon > 0),具有有界的((1 + \epsilon))阶矩)存在的情况下,为模型估计提供了理论保证。此外,现有的监督学习研究通常假设潜在因子回归或稀疏线性回归是真正的基础模型,却未对其充分性进行论证。为了填补高维推断方面的这一重要空白,我们还将我们的模型用作替代模型,以检验潜在因子回归模型和稀疏线性回归模型的充分性。为实现这些目标,我们分别提出了因子调整去偏检验(FabTest)和两阶段方差分析类型检验。我们还进行了大规模数值实验,包括合成数据和FRED宏观经济数据,以证实我们方法的理论性质。数值结果说明了我们的模型相对于潜在因子回归模型和稀疏线性回归模型的稳健性和有效性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9c32/11390100/f5c1980a3804/nihms-1871922-f0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9c32/11390100/f5c1980a3804/nihms-1871922-f0001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9c32/11390100/f5c1980a3804/nihms-1871922-f0001.jpg

相似文献

1
Are Latent Factor Regression and Sparse Regression Adequate?潜在因子回归和稀疏回归是否足够?
J Am Stat Assoc. 2024;119(546):1076-1088. doi: 10.1080/01621459.2023.2169700. Epub 2023 Feb 14.
2
Sparse Modal Additive Model.稀疏模态加法模型
IEEE Trans Neural Netw Learn Syst. 2021 Jun;32(6):2373-2387. doi: 10.1109/TNNLS.2020.3005144. Epub 2021 Jun 2.
3
Adaptive Huber Regression.自适应稳健回归
J Am Stat Assoc. 2020;115(529):254-265. doi: 10.1080/01621459.2018.1543124. Epub 2019 Apr 22.
4
Sparse Reduced Rank Huber Regression in High Dimensions.高维稀疏降秩Huber回归
J Am Stat Assoc. 2023;118(544):2383-2393. doi: 10.1080/01621459.2022.2050243. Epub 2022 Apr 15.
5
A SHRINKAGE PRINCIPLE FOR HEAVY-TAILED DATA: HIGH-DIMENSIONAL ROBUST LOW-RANK MATRIX RECOVERY.重尾数据的收缩原理:高维稳健低秩矩阵恢复
Ann Stat. 2021 Jun;49(3):1239-1266. doi: 10.1214/20-aos1980. Epub 2021 Aug 9.
6
Sparse latent factor regression models for genome-wide and epigenome-wide association studies.用于全基因组和表观基因组关联研究的稀疏潜在因子回归模型。
Stat Appl Genet Mol Biol. 2022 Mar 7;21(1):sagmb-2021-0035. doi: 10.1515/sagmb-2021-0035.
7
Online inference in high-dimensional generalized linear models with streaming data.具有流数据的高维广义线性模型中的在线推理
Electron J Stat. 2023;17(2):3443-3471. doi: 10.1214/23-ejs2182. Epub 2023 Nov 28.
8
Sparse Group Lasso: Optimal Sample Complexity, Convergence Rate, and Statistical Inference.稀疏组套索:最优样本复杂度、收敛速度与统计推断
IEEE Trans Inf Theory. 2022 Sep;68(9):5975-6002. doi: 10.1109/tit.2022.3175455. Epub 2022 May 16.
9
Minimax Optimal Bandits for Heavy Tail Rewards.重尾奖励的极小极大最优策略
IEEE Trans Neural Netw Learn Syst. 2024 Apr;35(4):5280-5294. doi: 10.1109/TNNLS.2022.3203035. Epub 2024 Apr 4.
10
Regularization Methods Based on the -Likelihood for Linear Models with Heavy-Tailed Errors.基于重尾误差线性模型的似然函数的正则化方法。
Entropy (Basel). 2020 Sep 16;22(9):1036. doi: 10.3390/e22091036.

引用本文的文献

1
Extensions of Heterogeneity in Integration and Prediction (HIP) With R Shiny Application.使用R Shiny应用程序扩展整合与预测中的异质性(HIP)
Stat Med. 2025 Apr;44(8-9):e70036. doi: 10.1002/sim.70036.

本文引用的文献

1
Understanding Implicit Regularization in Over-Parameterized Single Index Model.理解过参数化单指标模型中的隐式正则化
J Am Stat Assoc. 2023;118(544):2315-2328. doi: 10.1080/01621459.2022.2044824. Epub 2022 Mar 27.
2
Integrative Factor Regression and Its Inference for Multimodal Data Analysis.多模态数据分析的综合因子回归及其推断
J Am Stat Assoc. 2022;117(540):2207-2221. doi: 10.1080/01621459.2021.1914635. Epub 2021 May 20.
3
Adaptive Huber Regression.自适应稳健回归
J Am Stat Assoc. 2020;115(529):254-265. doi: 10.1080/01621459.2018.1543124. Epub 2019 Apr 22.
4
Factor-Adjusted Regularized Model Selection.因子调整正则化模型选择
J Econom. 2020 May;216(1):71-85. doi: 10.1016/j.jeconom.2020.01.006. Epub 2020 Feb 7.
5
LINEAR HYPOTHESIS TESTING FOR HIGH DIMENSIONAL GENERALIZED LINEAR MODELS.高维广义线性模型的线性假设检验
Ann Stat. 2019 Oct;47(5):2671-2703. doi: 10.1214/18-AOS1761. Epub 2019 Aug 3.
6
Robust estimation of high-dimensional covariance and precision matrices.高维协方差矩阵和精度矩阵的稳健估计。
Biometrika. 2018 Jun 1;105(2):271-284. doi: 10.1093/biomet/asy011. Epub 2018 Mar 27.
7
Embracing the Blessing of Dimensionality in Factor Models.拥抱因子模型中维度的福祉。
J Am Stat Assoc. 2018;113(521):380-389. doi: 10.1080/01621459.2016.1256815. Epub 2017 Nov 13.
8
Sufficient Forecasting Using Factor Models.使用因子模型进行充分预测。
J Econom. 2017 Dec;201(2):292-306. doi: 10.1016/j.jeconom.2017.08.009. Epub 2017 Aug 26.
9
Asymptotics of empirical eigenstructure for high dimensional spiked covariance.高维尖峰协方差的经验特征结构渐近性
Ann Stat. 2017 Jun;45(3):1342-1374. doi: 10.1214/16-AOS1487. Epub 2017 Jun 13.
10
Estimation of high dimensional mean regression in the absence of symmetry and light tail assumptions.在不存在对称性和轻尾假设的情况下对高维均值回归进行估计。
J R Stat Soc Series B Stat Methodol. 2017 Jan;79(1):247-265. doi: 10.1111/rssb.12166. Epub 2016 Apr 14.