Maros Máté E, Wenz Ralf, Förster Alex, Froelich Matthias F, Groden Christoph, Sommer Wieland H, Schönberg Stefan O, Henzler Thomas, Wenz Holger
Department of Neuroradiology, University Medical Center Mannheim, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany.
Department of Life Sciences, Faculty of Natural Sciences, Imperial College London, London, U.K.
In Vivo. 2018 Jul-Aug;32(4):843-849. doi: 10.21873/invivo.11318.
This feasibility study of text-mining-based scoring algorithm provides an objective comparison of structured reports (SR) and conventional free-text reports (cFTR) by means of guideline-based key terms. Furthermore, an open-source online version of this ranking algorithm was provided with multilingual text-retrieval pipeline, customizable query and real-time-scoring.
Twenty-five patients with suspected stroke and magnetic resonance imaging were re-assessed by two independent/blinded readers [inexperienced: 3 years; experienced >6 years/Board-certified). SR and cFTR were compared with guideline-query using the cosine similarity score (CSS) and Wilcoxon signed-rank test.
All pathological findings (18/18) were identified by SR and cFTR. The impressions section of the SRs of the inexperienced reader had the highest median (0.145) and maximal (0.214) CSS and were rated significantly higher (p=2.21×10 and p=1.4×10, respectively) than cFTR (median=0.102). CSS was robust to variations of query.
Objective guideline-based comparison of SRs and cFTRs using the CSS is feasible and provides a scalable quality measure that can facilitate the adoption of structured reports in all fields of radiology.
这项基于文本挖掘的评分算法的可行性研究，通过基于指南的关键词，对结构化报告（SR）和传统自由文本报告（cFTR）进行了客观比较。此外，该排名算法的开源在线版本配备了多语言文本检索管道、可定制查询和实时评分功能。
25例疑似中风且接受了磁共振成像检查的患者，由两名独立的/不知情的读者（经验不足：3年；经验丰富：>6年/获得委员会认证）重新评估。使用余弦相似性评分（CSS）和威尔科克森符号秩检验，将SR和cFTR与指南查询进行比较。
所有病理结果（18/18）均由SR和cFTR识别。经验不足的读者的SR的印象部分，CSS中位数最高（0.145），最大值（0.214），且评分显著高于cFTR（中位数=0.102）（分别为p=2.21×10和p=1.4×10）。CSS对查询变化具有鲁棒性。
使用CSS对SR和cFTR进行基于指南的客观比较是可行的，并提供了一种可扩展的质量度量，有助于在放射学的所有领域采用结构化报告。
