Xue Zhao-Feng, Wang Zi-Jia, Zhan Zhi-Hui, Kwong Sam, Zhang Jun
IEEE Trans Cybern. 2024 Dec;54(12):7541-7554. doi: 10.1109/TCYB.2024.3469371. Epub 2024 Nov 27.
Knowledge transfer (KT) is crucial for optimizing tasks in evolutionary multitask optimization (EMTO). However, most existing KT methods can only achieve superficial KT but lack the ability to deeply mine the similarities or relationships among different tasks. This limitation may result in negative transfer, thereby degrading the KT performance. As the KT efficiency strongly depends on the similarities of tasks, this article proposes a neural network (NN)-based KT (NNKT) method to analyze the similarities of tasks and obtain the transfer models for information prediction between different tasks for high-quality KT. First, NNKT collects and pairs the solutions of multiple tasks and trains the NNs to obtain the transfer models between tasks. Second, the obtained NNs transfer knowledge by predicting new promising solutions. Meanwhile, a simple adaptive strategy is developed to find the suitable population size to satisfy various search requirements during the evolution process. Comparison of the experimental results between the proposed NN-based multitask optimization (NNMTO) algorithm and some state-of-the-art multitask algorithms on the IEEE Congress on Evolutionary Computation (IEEE CEC) 2017 and IEEE CEC2022 benchmarks demonstrate the efficiency and effectiveness of the NNMTO. Moreover, NNKT can be seamlessly applied to other EMTO algorithms to further enhance their performances. Finally, the NNMTO is applied to a real-world multitask rover navigation application problem to further demonstrate its applicability.
知识转移(KT)对于优化进化多任务优化(EMTO)中的任务至关重要。然而,大多数现有的KT方法只能实现表面的KT,缺乏深入挖掘不同任务之间相似性或关系的能力。这种局限性可能导致负迁移,从而降低KT性能。由于KT效率强烈依赖于任务的相似性,本文提出了一种基于神经网络(NN)的KT(NNKT)方法,用于分析任务的相似性,并获得不同任务之间信息预测的迁移模型,以实现高质量的KT。首先,NNKT收集并配对多个任务的解,并训练神经网络以获得任务之间的迁移模型。其次,所获得的神经网络通过预测新的有前途的解来转移知识。同时,开发了一种简单的自适应策略,以找到合适的种群规模,以满足进化过程中的各种搜索要求。在2017年IEEE进化计算大会(IEEE CEC)和IEEE CEC2022基准测试中,将所提出的基于神经网络的多任务优化(NNMTO)算法与一些最先进的多任务算法的实验结果进行比较,证明了NNMTO的效率和有效性。此外,NNKT可以无缝应用于其他EMTO算法,以进一步提高它们的性能。最后,将NNMTO应用于一个实际的多任务漫游车导航应用问题,以进一步证明其适用性。