Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania.
Department of Pathology, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania.
J Am Soc Cytopathol. 2021 Sep-Oct;10(5):495-503. doi: 10.1016/j.jasc.2021.05.003. Epub 2021 May 19.
Cytopathology fellowships need measures to assess performance of fellows. We sought to compare several internal quantitative assessment metrics in our fellowship with external metrics, such as performance on the American Society of Cytopathology (ASC) Progressive Evaluation of Competency (PEC) examination and United States Medical Licensing Examination (USMLE).
Quantitative parameters generated from our laboratory information system (LIS) on cytopathology fellows were evaluated over 6 years, including case volume and diagnostic discrepancies, in addition to ASC PEC and USMLE scores. For discrepancy reports, interpretations made by the fellow were compared with that of the cytopathologist, and classified as none (concordant), minor (<2-levels) or major (≥2-levels).
We evaluated internal and external metrics on 13 fellows over 6 years. The program average diagnostic concordance rate was 89.9%, with an average major discrepancy rate of 1.5%, and an average monthly case volume of 260 cases. More fellows with above-average ASC PEC performance showed above-average concordant diagnoses and lower case volume, while below-average PEC scores were seen more often with higher major discrepancy rates. More fellows with above-average USMLE scores had higher case volumes, while low USMLE scores showed a trend towards higher major discrepancy rates.
Our fellowship program has used a variety of internal and external measures of performance for cytopathology fellows. Although the findings show no statistically significant finding correlating performance, these quantitative parameters generated from our LIS were helpful to identify areas of improvement, facilitate comparison to peers, and provide case volume documentation.
细胞病理学研究员需要有措施来评估研究员的表现。我们试图将我们的研究员的内部定量评估指标与外部指标（如美国细胞病理学学会（ASC）渐进式能力评估（PEC）考试和美国医师执照考试（USMLE）的表现）进行比较。
我们从实验室信息系统（LIS）中评估了 6 年来细胞病理学研究员的定量参数，包括病例量和诊断差异，以及 ASC PEC 和 USMLE 分数。对于差异报告，我们将研究员的解释与细胞病理学家的解释进行了比较，并将其分类为无（一致）、小（<2 级）或大（≥2 级）。
我们在 6 年内评估了 13 名研究员的内部和外部指标。该项目的平均诊断一致性率为 89.9%，平均主要差异率为 1.5%，平均每月病例量为 260 例。具有较高 ASC PEC 表现的研究员中，具有较高一致性诊断和较低病例量的比例较高，而较低的 PEC 分数则与较高的主要差异率相关。具有较高 USMLE 分数的研究员的病例量较高，而较低的 USMLE 分数则显示出较高的主要差异率趋势。
我们的研究员计划使用了各种内部和外部的细胞病理学研究员表现评估指标。尽管这些发现没有显示出与表现相关的统计学显著相关性，但从我们的 LIS 生成的这些定量参数有助于确定改进的领域，便于与同行比较，并提供病例量记录。
