Nucleic Acids Res. 2022 Jul 5;50(W1):W4-W12. doi: 10.1093/nar/gkac396.
Modeling 3D genome organisation has been booming in the last years thanks to the availability of experimental datasets of genomic contacts. However, the field is currently missing the standardisation of methods and metrics to compare predictions and experiments. We present 3DGenBench, a web server available at https://inc-cost.eu/benchmarking/, that allows benchmarking computational models of 3D Genomics. The benchmark is performed using a manually curated dataset of 39 capture Hi-C profiles in wild type and genome-edited mouse cells, and five genome-wide Hi-C profiles in human, mouse, and Drosophila cells. 3DGenBench performs two kinds of analysis, each supplied with a specific scoring module that compares predictions of a computational method to experimental data using several metrics. With 3DGenBench, the user obtains model performance scores, allowing an unbiased comparison with other models. 3DGenBench aims to become a reference web server to test new 3D genomics models and is conceived as an evolving platform where new types of analysis will be implemented in the future.
近年来,得益于基因组接触实验数据集的可用性,三维基因组结构建模得到了蓬勃发展。然而,目前该领域缺乏用于比较预测和实验的方法和指标的标准化。我们介绍了 3DGenBench,这是一个可在 https://inc-cost.eu/benchmarking/ 访问的网络服务器,它允许对三维基因组学的计算模型进行基准测试。该基准测试使用了一个经过手动整理的数据集,其中包括野生型和基因组编辑的小鼠细胞中的 39 个捕获 Hi-C 图谱,以及人类、小鼠和果蝇细胞中的 5 个全基因组 Hi-C 图谱。3DGenBench 执行两种分析,每种分析都提供了一个特定的评分模块,该模块使用多个指标将计算方法的预测与实验数据进行比较。使用 3DGenBench,用户可以获得模型性能评分,从而可以与其他模型进行无偏比较。3DGenBench 旨在成为测试新的三维基因组学模型的参考网络服务器,并被设想为一个不断发展的平台,未来将实现新类型的分析。