Department of Civil and Environmental Engineering, Case Western Reserve University, 2104 Adelbert Road, Cleveland, Ohio 44106-7201, United States.
School of Civil Engineering and Transportation, Hebei University of Technology, Tianjin 300401, China.
Environ Sci Technol. 2022 Jan 4;56(1):681-692. doi: 10.1021/acs.est.1c04883. Epub 2021 Dec 15.
To develop predictive models for the reactivity of organic contaminants toward four oxidants─SO, HClO, O, and ClO─all with small sample sizes, we proposed two approaches: combining small data sets and transferring knowledge between them. We first merged these data sets and developed a unified model using machine learning (ML), which showed better predictive performance than the individual models for HClO (RMSE: 2.1 to 2.04), O (2.06 to 1.94), ClO (1.77 to 1.49), and SO (0.75 to 0.70) because the model "corrected" the wrongly learned effects of several atom groups. We further developed knowledge transfer models for three pairs of the data sets and observed different predictive performances: improved for O (RMSE: 2.06 to 2.01)/HClO (2.10 to 1.98), mixed for O (2.06 to 2.01)/ClO (1.77 to 1.95), and unchanged for ClO (1.77 to 1.77)/HClO (2.1 to 2.1). The effectiveness of the latter approach depended on whether there was consistent knowledge shared between the data sets and on the performance of the individual models. We also compared our approaches with multitask learning and image-based transfer learning and found that our approaches consistently improved the predictive performance for all data sets while the other two did not. This study demonstrated the effectiveness of combining small, similar data sets and transferring knowledge between them to improve ML model performance.
为了针对四种氧化剂(SO、HClO、O 和 ClO)的反应性开发预测有机污染物的模型,我们提出了两种方法:结合小数据集并在它们之间转移知识。我们首先合并了这些数据集,并使用机器学习(ML)开发了一个统一的模型,该模型对 HClO(RMSE:2.1 到 2.04)、O(2.06 到 1.94)、ClO(1.77 到 1.49)和 SO(0.75 到 0.70)的预测性能均优于单个模型,因为模型“纠正”了几个原子团错误学习的效果。我们进一步为三对数据集开发了知识转移模型,并观察到不同的预测性能:O(RMSE:2.06 到 2.01)/HClO(2.10 到 1.98)得到了改善,O(2.06 到 2.01)/ClO(1.77 到 1.95)则混合,而 ClO(1.77 到 1.77)/HClO(2.1 到 2.1)则没有变化。后一种方法的有效性取决于数据集之间是否存在一致的知识以及单个模型的性能。我们还将我们的方法与多任务学习和基于图像的迁移学习进行了比较,发现我们的方法始终可以提高所有数据集的预测性能,而其他两种方法则没有。这项研究证明了结合小而相似的数据集并在它们之间转移知识以提高 ML 模型性能的有效性。