Sun Mingwei, Xu Murong
Department of Math and Computer Science, Samford University, Birmingha, AL, USA.
Department of Mathematics, The University of Scranton, Scranton, PA, USA.
J Appl Stat. 2024 Apr 26;51(15):3215-3232. doi: 10.1080/02664763.2024.2346343. eCollection 2024.
This paper introduces a novel Principal-Weighted Penalized (PWP) regression model, designed for dimensionality reduction in large datasets without sacrificing essential information. This new model retains the favorable features of the principal component analysis (PCA) technique and penalized regression models. It weighs the variables in a large data set based on their contributions to principal components identified by PCA, enhancing its capacity to uncover crucial hidden variables. The PWP model also efficiently performs variable selection and estimates regression coefficients through regularization. An application of the proposed model on high-dimensional economic data is studied. The results of comparative studies in simulations and a real example in economic modeling demonstrate its superior fitting and predictive abilities. The resulting model excels in accuracy and interpretability, outperforming existing methods.
本文介绍了一种新颖的主加权惩罚(PWP)回归模型,该模型旨在对大型数据集进行降维,同时不损失重要信息。这种新模型保留了主成分分析(PCA)技术和惩罚回归模型的有利特征。它根据变量对PCA识别出的主成分的贡献对大型数据集中的变量进行加权,增强了其发现关键隐藏变量的能力。PWP模型还通过正则化有效地进行变量选择并估计回归系数。研究了所提出模型在高维经济数据上的应用。模拟中的比较研究结果以及经济建模中的一个实际例子表明了其卓越的拟合和预测能力。所得模型在准确性和可解释性方面表现出色,优于现有方法。