Xu Weinan, Wong Weng Kee, Tan Kay Chen, Xu Jianxin
IEEE Access. 2019;7:7133-7146. doi: 10.1109/ACCESS.2018.2890593. Epub 2019 Jan 1.
D-optimal designs are frequently used in controlled experiments to obtain the most accurate estimate of model parameters at minimal cost. Finding them can be a challenging task, especially when there are many factors in a nonlinear model. As the number of factors becomes large and interact with one another, there are many more variables to optimize and the D-optimal design problem becomes high-dimensional and non-separable. Consequently, premature convergence issues arise. Candidate solutions get trapped in local optima and the classical gradient-based optimization approaches to search for the D-optimal designs rarely succeed. We propose a specially designed version of differential evolution (DE) which is a representative gradient-free optimization approach to solve such high-dimensional optimization problems. The proposed specially designed DE uses a new novelty-based mutation strategy to explore the various regions in the search space. The exploration of the regions will be carried out differently from the previously explored regions and the diversity of the population can be preserved. The proposed novelty-based mutation strategy is collaborated with two common DE mutation strategies to balance exploration and exploitation at the early or medium stage of the evolution. Additionally, we adapt the control parameters of DE as the evolution proceeds. Using logistic models with several factors on various design spaces as examples, our simulation results show our algorithm can find D-optimal designs efficiently and the algorithm outperforms its competitors. As an application, we apply our algorithm and re-design a 10-factor car refueling experiment with discrete and continuous factors and selected pairwise interactions. Our proposed algorithm was able to consistently outperform the other algorithms and find a more efficient D-optimal design for the problem.
D - 最优设计常用于对照实验,以最小成本获得模型参数的最准确估计。找到这些设计可能是一项具有挑战性的任务,尤其是当非线性模型中有许多因素时。随着因素数量增多且相互作用,需要优化的变量更多,D - 最优设计问题变得高维且不可分离。因此,会出现早熟收敛问题。候选解被困在局部最优中,而用于搜索D - 最优设计的传统基于梯度的优化方法很少成功。我们提出了一种专门设计的差分进化(DE)版本,它是一种具有代表性的无梯度优化方法,用于解决此类高维优化问题。所提出的专门设计的DE使用一种基于新颖性的新变异策略来探索搜索空间中的各个区域。对这些区域的探索将与之前探索的区域不同,并且可以保持种群的多样性。所提出的基于新颖性的变异策略与两种常见的DE变异策略协作,以在进化的早期或中期平衡探索和利用。此外,我们随着进化过程调整DE的控制参数。以在各种设计空间上具有多个因素的逻辑模型为例,我们的模拟结果表明我们的算法可以有效地找到D - 最优设计,并且该算法优于其竞争对手。作为一个应用,我们应用我们的算法重新设计了一个具有离散和连续因素以及选定成对相互作用的10因素汽车加油实验。我们提出的算法能够始终优于其他算法,并为该问题找到更有效的D - 最优设计。