Hillis Stephen L, Berbaum Kevin S, Metz Charles E
Center for Research in the Implementation of Innovative Strategies in Practice (CRIISP), Iowa City VA Medical Center (152), Iowa City, IA, USA.
Acad Radiol. 2008 May;15(5):647-61. doi: 10.1016/j.acra.2007.12.015.
The Dorfman-Berbaum-Metz (DBM) method has been one of the most popular methods for analyzing multireader receiver-operating characteristic (ROC) studies since it was proposed in 1992. Despite its popularity, the original procedure has several drawbacks: it is limited to jackknife accuracy estimates, it is substantially conservative, and it is not based on a satisfactory conceptual or theoretical model. Recently, solutions to these problems have been presented in three papers. Our purpose is to summarize and provide an overview of these recent developments.
We present and discuss the recently proposed solutions for the various drawbacks of the original DBM method.
We compare the solutions in a simulation study and find that they result in improved performance for the DBM procedure. We also compare the solutions using two real data studies and find that the modified DBM procedure that incorporates these solutions yields more significant results and clearer interpretations of the variance component parameters than the original DBM procedure.
We recommend using the modified DBM procedure that incorporates the recent developments.
自1992年提出以来，多夫曼 - 伯鲍姆 - 梅茨（DBM）方法一直是分析多读者接收者操作特征（ROC）研究中最常用的方法之一。尽管该方法很受欢迎，但其原始程序存在几个缺点：它仅限于刀切法精度估计，相当保守，且并非基于令人满意的概念或理论模型。最近，三篇论文提出了解决这些问题的方法。我们的目的是总结并概述这些最新进展。
我们介绍并讨论了针对原始DBM方法各种缺点最近提出的解决方案。
我们在模拟研究中比较了这些解决方案，发现它们提高了DBM程序的性能。我们还使用两项实际数据研究比较了这些解决方案，发现纳入这些解决方案的改进后的DBM程序比原始DBM程序产生更显著的结果，并且对方差成分参数的解释更清晰。
我们建议使用纳入了最新进展的改进后的DBM程序。
