Zhu Yuanzheng
School of Statistics, Southwestern University of Finance and Economics, Chengdu 611130, China.
Entropy (Basel). 2023 Aug 18;25(8):1234. doi: 10.3390/e25081234.
Sampling from constrained distributions has posed significant challenges in terms of algorithmic design and non-asymptotic analysis, which are frequently encountered in statistical and machine-learning models. In this study, we propose three sampling algorithms based on Langevin Monte Carlo with the Metropolis-Hastings steps to handle the distribution constrained within some convex body. We present a rigorous analysis of the corresponding Markov chains and derive non-asymptotic upper bounds on the convergence rates of these algorithms in total variation distance. Our results demonstrate that the sampling algorithm, enhanced with the Metropolis-Hastings steps, offers an effective solution for tackling some constrained sampling problems. The numerical experiments are conducted to compare our methods with several competing algorithms without the Metropolis-Hastings steps, and the results further support our theoretical findings.
从受限分布中进行采样在算法设计和非渐近分析方面带来了重大挑战,这些挑战在统计和机器学习模型中经常遇到。在本研究中,我们提出了三种基于带有Metropolis-Hastings步骤的朗之万蒙特卡罗方法的采样算法,以处理在某些凸体内受限的分布。我们对相应的马尔可夫链进行了严格分析,并在总变差距离中推导出这些算法收敛速率的非渐近上界。我们的结果表明,用Metropolis-Hastings步骤增强的采样算法为解决一些受限采样问题提供了有效的解决方案。进行了数值实验,将我们的方法与几种没有Metropolis-Hastings步骤的竞争算法进行比较,结果进一步支持了我们的理论发现。