Suppr超能文献

使用《乳腺影像报告和数据系统(BI-RADS)-超声》第五版(2013年)时,教员与住院医师之间观察者表现的差异

Variability in Observer Performance Between Faculty Members and Residents Using Breast Imaging Reporting and Data System (BI-RADS)-Ultrasound, Fifth Edition (2013).

作者信息

Lee Youn Joo, Choi So Young, Kim Kyu Sun, Yang Po Song

机构信息

Department of Radiology, Daejeon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Daejeon, Republic of Korea.

Department of Radiology, Eulji University Hospital, Daejeon, Republic of Korea.

出版信息

Iran J Radiol. 2016 Jan 9;13(3):e28281. doi: 10.5812/iranjradiol.28281. eCollection 2016 Jul.

Abstract

BACKGROUND

Ultrasonography (US) is a useful tool for breast imaging, yet is highly operator-dependent.

OBJECTIVES

We evaluated inter-observer variability and performance discrepancies between faculty members and radiology residents when describing breast lesions, by the fifth edition of breast imaging reporting and data system (BI-RADS)-US lexicon, and then attempted to identify whether inter-observer variability could be improved after one education session.

PATIENTS AND METHODS

In total, 50 malignant lesions and 70 benign lesions were considered in our retrospective study. Two faculty members, two senior residents, and two junior residents separately assessed the US images. After the first assessment, the readers received one education session, and then reassessed the images in a random order. Inter-observer variability was measured using the kappa coefficient (κ). Performance discrepancy was evaluated by receiver operating characteristic (ROC) curves.

RESULTS

For the faculty members, fair-to-good agreement was obtained in all descriptors and final assessment, while for residents, poor-to-moderate agreement was obtained. The areas under the ROC curves were 0.78 for the faculty members, 0.59 for the senior residents, and 0.52 for the junior residents, respectively. Diagnostic performance was significantly higher in the faculty members than the senior and junior residents (P = 0.0001 and < 0.0001, respectively). After one education session, the agreement in the final assessment was one level higher in the faculty members and senior residents, yet in the senior residents, the degree of agreement was still only fair. Moreover, in the junior residents, there was no improvement.

CONCLUSION

Investigative assessment of breast US by residents is inadvisable. We recommend continued professional resident training to improve the degree of agreement and performance.

摘要

背景

超声检查(US)是乳腺成像的一种有用工具,但高度依赖操作者。

目的

我们依据乳腺影像报告和数据系统(BI-RADS)-US词典第五版,评估了教员与放射科住院医师在描述乳腺病变时的观察者间变异性及表现差异,然后试图确定经过一次培训课程后观察者间变异性是否能得到改善。

患者与方法

在我们的回顾性研究中,共纳入50个恶性病变和70个良性病变。两名教员、两名高年资住院医师和两名低年资住院医师分别对超声图像进行评估。首次评估后,观察者接受一次培训课程,然后以随机顺序重新评估图像。观察者间变异性采用kappa系数(κ)进行测量。通过受试者操作特征(ROC)曲线评估表现差异。

结果

对于教员,在所有描述符和最终评估中均获得了中等至良好的一致性,而对于住院医师,则获得了差至中等的一致性。教员、高年资住院医师和低年资住院医师的ROC曲线下面积分别为0.78、0.59和0.52。教员的诊断表现显著高于高年资和低年资住院医师(P分别为0.0001和<0.0001)。经过一次培训课程后,教员和高年资住院医师在最终评估中的一致性提高了一个等级,但高年资住院医师的一致程度仍仅为中等。此外,低年资住院医师没有改善。

结论

住院医师对乳腺超声进行研究性评估是不可取的。我们建议持续对住院医师进行专业培训,以提高一致性程度和表现。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a4a9/5106650/b988471cb7ec/iranjradiol-13-03-28281-i001.jpg

相似文献

2
Comparison of Inter-Observer Variability and Diagnostic Performance of the Fifth Edition of BI-RADS for Breast Ultrasound of Static versus Video Images.
Ultrasound Med Biol. 2016 Sep;42(9):2083-8. doi: 10.1016/j.ultrasmedbio.2016.05.006. Epub 2016 Jun 18.
3
Observer variability and the performance between faculties and residents: US criteria for benign and malignant thyroid nodules.
Korean J Radiol. 2010 Mar-Apr;11(2):149-55. doi: 10.3348/kjr.2010.11.2.149. Epub 2010 Feb 22.
4
Observer variability of Breast Imaging Reporting and Data System (BI-RADS) for breast ultrasound.
Eur J Radiol. 2008 Feb;65(2):293-8. doi: 10.1016/j.ejrad.2007.04.008. Epub 2007 May 24.
6
BI-RADS lexicon for US and mammography: interobserver variability and positive predictive value.
Radiology. 2006 May;239(2):385-91. doi: 10.1148/radiol.2392042127. Epub 2006 Mar 28.
7
Inter- and Intra-Observer Agreement in Ultrasound BI-RADS Classification and Real-Time Elastography Tsukuba Score Assessment of Breast Lesions.
Ultrasound Med Biol. 2016 Nov;42(11):2622-2629. doi: 10.1016/j.ultrasmedbio.2016.06.017. Epub 2016 Aug 5.
10
Interobserver Variability Between Breast Imagers Using the Fifth Edition of the BI-RADS MRI Lexicon.
AJR Am J Roentgenol. 2015 May;204(5):1120-4. doi: 10.2214/AJR.14.13047.

引用本文的文献

7
Ultrasound-based deep learning in the establishment of a breast lesion risk stratification system: a multicenter study.
Eur Radiol. 2023 Apr;33(4):2954-2964. doi: 10.1007/s00330-022-09263-8. Epub 2022 Nov 23.
8
Can Pre-biopsy Second-Look Breast Ultrasound Affect Clinical Management? Experience From a Single Tertiary Hospital.
Front Oncol. 2022 May 31;12:901757. doi: 10.3389/fonc.2022.901757. eCollection 2022.
9
S-Thyroid Computer-Aided Diagnosis Ultrasound System of Thyroid Nodules: Correlation Between Transverse and Longitudinal Planes.
Front Physiol. 2022 May 20;13:909277. doi: 10.3389/fphys.2022.909277. eCollection 2022.

本文引用的文献

1
Interobserver and Intraobserver Agreement of Sonographic BIRADS Lexicon in the Assessment of Breast Masses.
Iran J Radiol. 2013 Sep;10(3):122-7. doi: 10.5812/iranjradiol.10708. Epub 2013 Aug 30.
2
Interobserver concordance in the BI-RADS classification of breast ultrasound exams.
Clinics (Sao Paulo). 2012;67(2):185-9. doi: 10.6061/clinics/2012(02)16.
3
The breast ultrasound lexicon: breast imaging reporting and data system (BI-RADS).
Semin Roentgenol. 2011 Oct;46(4):245-51. doi: 10.1053/j.ro.2011.04.001.
5
Breast imaging reporting and data system lexicon for US: interobserver agreement for assessment of breast masses.
Radiology. 2009 Sep;252(3):665-72. doi: 10.1148/radiol.2523080670. Epub 2009 Jun 30.
8
Clinical application of the BI-RADS final assessment to breast sonography in conjunction with mammography.
AJR Am J Roentgenol. 2008 May;190(5):1209-15. doi: 10.2214/AJR.07.3259.
9
Accuracy of classification of breast ultrasound findings based on criteria used for BI-RADS.
Ultrasound Obstet Gynecol. 2008 Sep;32(4):573-8. doi: 10.1002/uog.5191.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验