Wu Jimeng, D'Ambrosi Simone, Ammann Lorenz, Stadnicka-Michalak Julita, Schirmer Kristin, Baity-Jesi Marco
Eawag, Überlandstrasse 133, CH-8600 Dübendorf, Switzerland; Department of Environmental Engineering, ETHZ, Zurich, Switzerland.
Department of Statistics, Sapienza University of Rome, Piazzale Aldo Moro, 5, 00185 Rome, RM, Italy.
Environ Int. 2022 May;163:107184. doi: 10.1016/j.envint.2022.107184. Epub 2022 Mar 17.
We applied machine learning methods to predict chemical hazards focusing on fish acute toxicity across taxa. We analyzed the relevance of taxonomy and experimental setup, showing that taking them into account can lead to considerable improvements in the classification performance. We quantified the gain obtained throught the introduction of taxonomic and experimental information, compared to classification based on chemical information alone. We used our approach with standard machine learning models (K-nearest neighbors, random forests and deep neural networks), as well as the recently proposed Read-Across Structure Activity Relationship (RASAR) models, which were very successful in predicting chemical hazards to mammals based on chemical similarity. We were able to obtain accuracies of over 93% on datasets where, due to noise in the data, the maximum achievable accuracy was expected to be below 96%. The best performances were obtained by random forests and RASAR models. We analyzed metrics to compare our results with animal test reproducibility, and despite most of our models "outperform animal test reproducibility" as measured through recently proposed metrics, we showed that the comparison between machine learning performance and animal test reproducibility should be addressed with particular care. While we focused on fish mortality, our approach, provided that the right data is available, is valid for any combination of chemicals, effects and taxa.
我们应用机器学习方法来预测化学危害,重点关注跨分类群的鱼类急性毒性。我们分析了分类学和实验设置的相关性,表明将它们考虑在内可显著提高分类性能。我们量化了与仅基于化学信息的分类相比,通过引入分类学和实验信息所获得的收益。我们将我们的方法与标准机器学习模型(K近邻、随机森林和深度神经网络)以及最近提出的基于化学相似性在预测对哺乳动物的化学危害方面非常成功的跨读结构活性关系(RASAR)模型一起使用。在数据存在噪声、预期最大可实现准确率低于96%的数据集上,我们能够获得超过93%的准确率。随机森林和RASAR模型取得了最佳性能。我们分析了各项指标以将我们的结果与动物试验可重复性进行比较,尽管通过最近提出的指标衡量我们的大多数模型“优于动物试验可重复性”,但我们表明机器学习性能与动物试验可重复性之间的比较应格外谨慎。虽然我们关注的是鱼类死亡率,但只要有合适的数据,我们的方法对任何化学物质、效应和分类群的组合都是有效的。