Mallick Himel, Yi Nengjun
Department of Biostatistics, Harvard T. H. Chan School of Public Health, Boston, MA 02115, USA.
Program in Medical and Population Genetics, Broad Institute of MIT and Harvard, Cambridge, MA 02142, USA.
J Appl Stat. 2018;45(6):988-1008. doi: 10.1080/02664763.2017.1324565. Epub 2017 May 10.
Classical bridge regression is known to possess many desirable statistical properties such as oracle, sparsity, and unbiasedness. One outstanding disadvantage of bridge regularization, however, is that it lacks a systematic approach to inference, reducing its flexibility in practical applications. In this study, we propose bridge regression from a Bayesian perspective. Unlike classical bridge regression that summarizes inference using a single point estimate, the proposed Bayesian method provides uncertainty estimates of the regression parameters, allowing coherent inference through the posterior distribution. Under a sparsity assumption non the high-dimensional parameter, we provide sufficient conditions for strong posterior consistency of the Bayesian bridge prior. On simulated datasets, we show that the proposed method performs well compared to several competing methods across a wide range of scenarios. Application to two real datasets further revealed that the proposed method performs as well as or better than published methods while offering the advantage of posterior inference.
经典桥回归已知具有许多理想的统计特性,如神谕性、稀疏性和无偏性。然而,桥正则化的一个突出缺点是它缺乏一种系统的推断方法,这降低了其在实际应用中的灵活性。在本研究中,我们从贝叶斯角度提出桥回归。与使用单点估计总结推断的经典桥回归不同,所提出的贝叶斯方法提供回归参数的不确定性估计,允许通过后验分布进行连贯推断。在高维参数的稀疏性假设下,我们为贝叶斯桥先验的强后验一致性提供了充分条件。在模拟数据集上,我们表明所提出的方法在广泛的场景中与几种竞争方法相比表现良好。应用于两个真实数据集进一步表明,所提出的方法与已发表的方法表现相当或更好,同时具有后验推断的优势。