Gaines Brian R, Kim Juhyun, Zhou Hua
Department of Statistics, North Carolina State University.
Department of Biostatistics, University of California, Los Angeles (UCLA).
J Comput Graph Stat. 2018;27(4):861-871. doi: 10.1080/10618600.2018.1473777. Epub 2018 Aug 7.
We compare alternative computing strategies for solving the constrained lasso problem. As its name suggests, the constrained lasso extends the widely-used lasso to handle linear constraints, which allow the user to incorporate prior information into the model. In addition to quadratic programming, we employ the alternating direction method of multipliers (ADMM) and also derive an efficient solution path algorithm. Through both simulations and benchmark data examples, we compare the different algorithms and provide practical recommendations in terms of efficiency and accuracy for various sizes of data. We also show that, for an arbitrary penalty matrix, the generalized lasso can be transformed to a constrained lasso, while the converse is not true. Thus, our methods can also be used for estimating a generalized lasso, which has wide-ranging applications. Code for implementing the algorithms is freely available in both the Matlab toolbox SparseReg and the Julia package ConstrainedLasso. Supplementary materials for this article are available online.
我们比较了解决约束套索问题的替代计算策略。顾名思义,约束套索将广泛使用的套索进行了扩展,以处理线性约束,这使得用户能够将先验信息纳入模型。除了二次规划,我们还采用了乘子交替方向法(ADMM),并推导了一种有效的解路径算法。通过模拟和基准数据示例,我们比较了不同的算法,并针对各种规模的数据在效率和准确性方面提供了实用建议。我们还表明,对于任意惩罚矩阵,广义套索可以转换为约束套索,反之则不成立。因此,我们的方法也可用于估计具有广泛应用的广义套索。实现这些算法的代码可在Matlab工具箱SparseReg和Julia包ConstrainedLasso中免费获取。本文的补充材料可在线获取。