Department of Radiology, Queen Alexandra Hospital, Portsmouth, UK.
Clin Radiol. 2013 Nov;68(11):1146-54. doi: 10.1016/j.crad.2013.06.019. Epub 2013 Aug 12.
To review the development of a workplace-based assessment tool to assess the quality of written radiology reports and assess its reliability, feasibility, and validity.
A comprehensive literature review and rigorous Delphi study enabled the development of the Bristol Radiology Report Assessment Tool (BRRAT), which consists of 19 questions and a global assessment score. Three assessors applied the assessment tool to 240 radiology reports provided by 24 radiology trainees.
The reliability coefficient for the 19 questions was 0.79 and the equivalent coefficient for the global assessment scores was 0.67. Generalizability coefficients demonstrate that higher numbers of assessors and assessments are needed to reach acceptable levels of reliability for summative assessments due to assessor subjectivity.
The study methodology gives good validity and strong foundation in best-practice. The assessment tool developed for radiology reporting is reliable and most suited to formative assessments.
回顾一种基于工作场所的评估工具的发展，以评估放射科报告的质量，并评估其可靠性、可行性和有效性。
全面的文献回顾和严格的德尔菲研究使 Bristol 放射学报告评估工具（BRRAT）得以开发，该工具由 19 个问题和一个整体评估分数组成。三名评估员对 24 名放射科学员提供的 240 份放射科报告应用了评估工具。
19 个问题的可靠性系数为 0.79，整体评估分数的等效系数为 0.67。由于评估员的主观性，需要更多的评估员和评估来达到总结性评估可接受的可靠性水平，这表明通用性系数。
该研究方法具有良好的有效性和最佳实践的坚实基础。为放射科报告开发的评估工具具有可靠性，最适合形成性评估。
