Kusta Olsi, Rift Charlotte Vestrup, Risør Torsten, Santoni-Rugiu Eric, Brodersen John Brandt
Department of Public Health, University of Copenhagen, Øster Farimagsgade 5 opg. B, Building: 15-0-11, 1014 Copenhagen, Denmark.
Centre for Research in Assessment and Digital Learning (CRADLE), Deakin University, Melbourne, Australia.
J Pathol Inform. 2022 Sep 6;13:100136. doi: 10.1016/j.jpi.2022.100136. eCollection 2022.
Digital pathology solutions are increasingly implemented for primary diagnostics in departments of pathology around the world. This has sparked a growing engagement on validation studies to evaluate the diagnostic performance of whole slide imaging (WSI) regarding safety, reliability, and accuracy. The aim of this review was to evaluate the performance of digital pathology for diagnostic purposes compared to light microscopy (LM) in human pathology, based on validation studies designed to assess such technologies.
In this systematic review based on PRISMA guidelines, we analyzed validation studies of WSI compared with LM. We included studies of diagnostic performance of WSI regarding diagnostic test accuracy (DTA) indicators, degree of overdiagnosis, diagnostic concordance, and observer variability as a secondary outcome. Overdiagnosis is (for example) detecting a pathological condition that will either not progress or progress very slowly. Thus, the patient will never get symptoms from this condition and the pathological condition will never be the cause of death. From a search comprising four databases: PubMed, EMBASE, Cochrane Library, and Web of Science, encompassing the period 2010-2021, we selected and screened 12 peer-reviewed articles that fulfilled our selection criteria. Risk of bias was conducted through QUADAS-2 tool, and data analysis and synthesis were performed in a qualitative format.
We found that diagnostic performance of WSI was not inferior to LM for DTA indicators, concordance, and observer variability. The degree of overdiagnosis was not explicitly reported in any of the studies, while the term itself was used in one study and could be implicitly calculated in another.
WSI had an overall high diagnostic accuracy based on traditional accuracy measurements; however, the degree of overdiagnosis is unknown.
数字病理学解决方案在全球各地的病理学部门越来越多地用于初步诊断。这引发了越来越多关于验证研究的参与,以评估全切片成像(WSI)在安全性、可靠性和准确性方面的诊断性能。本综述的目的是基于旨在评估此类技术的验证研究,比较数字病理学与光学显微镜(LM)在人体病理学诊断中的性能。
在这项基于PRISMA指南的系统综述中,我们分析了WSI与LM的验证研究。我们纳入了关于WSI诊断性能的研究,涉及诊断测试准确性(DTA)指标、过度诊断程度、诊断一致性以及作为次要结果的观察者变异性。过度诊断(例如)是指检测到一种不会进展或进展非常缓慢的病理状况。因此,患者永远不会出现该状况的症状,并且该病理状况永远不会成为死亡原因。通过对包括四个数据库(PubMed、EMBASE、Cochrane图书馆和科学网)的检索,涵盖2010 - 2021年期间,我们筛选出12篇符合我们选择标准的同行评审文章。通过QUADAS - 2工具进行偏倚风险评估,并以定性形式进行数据分析和综合。
我们发现,对于DTA指标、一致性和观察者变异性,WSI的诊断性能并不逊于LM。在任何一项研究中均未明确报告过度诊断的程度,而在一项研究中使用了该术语本身,在另一项研究中可以隐含计算。
基于传统准确性测量,WSI总体具有较高的诊断准确性;然而,过度诊断的程度尚不清楚。