Cohen Gilles, Meyer Rodolphe
Direction of Medico Economic Analysis, University Hospital of Geneva, 1211 Geneva, Switzerland.
Stud Health Technol Inform. 2011;169:554-8.
This paper considers the model selection problem for Support Vector Machines. A well-known derivative Pattern Search method, which aims to tune hyperparameter values using an empirical error estimate as a steering criterion, is proposed. This approach is experimentally evaluated on a health care problem which involves discriminating nosocomially infected patients from non-infected patients. The Hooke and Jeeves Pattern Search (HJPS) method is shown to improve the results achieved by Grid Search (GS) in terms of solution quality and computational efficiency. Unlike most other parameter tuning techniques, our approach does not require supplementary effort such as computation of derivatives, making them well suited for practical purposes. This method produces encouraging results: it exhibits good performance and convergence properties.
本文探讨了支持向量机的模型选择问题。提出了一种著名的导数模式搜索方法,该方法旨在使用经验误差估计作为指导标准来调整超参数值。在一个涉及区分医院感染患者和未感染患者的医疗保健问题上,对该方法进行了实验评估。结果表明,Hooke和Jeeves模式搜索(HJPS)方法在解的质量和计算效率方面优于网格搜索(GS)方法。与大多数其他参数调整技术不同,我们的方法不需要诸如导数计算等额外的工作,因此非常适合实际应用。该方法产生了令人鼓舞的结果:它表现出良好的性能和收敛特性。