Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, East Melbourne, Australia; Ophthalmology, Department of Surgery, The University of Melbourne, Melbourne, Australia.
GRADE Reading Center and Department of Ophthalmology, University of Bonn, Bonn, Germany; Ophthalmic Genetics and Visual Function Branch, National Eye Institute, National Institutes of Health, Bethesda, Maryland.
Ophthalmol Retina. 2022 Jan;6(1):4-14. doi: 10.1016/j.oret.2021.03.008. Epub 2021 Mar 23.
To determine the interreader agreement for incomplete retinal pigment epithelium (RPE) and outer retinal atrophy (iRORA) and complete RPE and outer retinal atrophy (cRORA) and their related features in age-related macular degeneration (AMD).
Interreader agreement study.
Twelve readers from 6 reading centers.
After formal training, readers qualitatively assessed 60 OCT B-scans from 60 eyes with AMD for 9 individual features associated with early atrophy and performed 7 different annotations to quantify the spatial extent of OCT features within regions of interest. The qualitative and quantitative features were used to derive the presence of iRORA and cRORA and also in an exploratory analysis to examine if agreement could be improved using different combinations of features to define OCT atrophy.
Interreader agreement based on Gwet's first-order agreement coefficient (AC) for qualitatively graded OCT features and classification of iRORA and cRORA, and smallest real difference (SRD) for quantitatively graded OCT features.
Substantial or better interreader agreement was observed for all qualitatively graded OCT features associated with atrophy (AC = 0.63-0.87), except for RPE attenuation (AC = 0.46) and disruption (AC = 0.26). The lowest SRD for the quantitatively graded horizontal features was observed for the zone of choroidal hypertransmission (± 190.8 μm). Moderate agreement was found for a 3-category classification of no atrophy, iRORA, and cRORA (AC = 0.53). Exploratory analyses suggested a significantly higher level of agreement for a 3-category classification using (1) no atrophy; (2) presence of inner nuclear layer and outer plexiform layer subsidence, or a hyporeflective wedge-shaped band, as a less severe atrophic grade; and (3) the latter plus an additional requirement of choroidal hypertransmission of 250 μm or more for a more severe atrophic grade (AC = 0.68; P = 0.013).
Assessment of iRORA and cRORA, and most of their associated features, can be performed relatively consistently and robustly. A refined combination of features to define early atrophy could further improve interreader agreement.
确定年龄相关性黄斑变性(AMD)中不完全性视网膜色素上皮(RPE)和外层视网膜萎缩(iRORA)以及完全性 RPE 和外层视网膜萎缩(cRORA)及其相关特征的读者间一致性。
读者间一致性研究。
来自 6 个阅读中心的 12 名读者。
经过正式培训后,读者对 60 只 AMD 眼的 60 个 OCT B 扫描进行了定性评估,评估了 9 个与早期萎缩相关的单个特征,并进行了 7 种不同的标注,以量化感兴趣区域内 OCT 特征的空间范围。使用定性和定量特征来确定 iRORA 和 cRORA 的存在,并且在探索性分析中,检查是否可以使用不同的特征组合来定义 OCT 萎缩来提高一致性。
基于 Gwet 一阶一致性系数(AC)的定性分级 OCT 特征和 iRORA 和 cRORA 的分类,以及定量分级 OCT 特征的最小实际差异(SRD)的读者间一致性。
观察到与萎缩相关的所有定性分级 OCT 特征都具有显著或更好的读者间一致性(AC=0.63-0.87),除了 RPE 衰减(AC=0.46)和破坏(AC=0.26)。定量分级水平特征的最小 SRD 出现在脉络膜高透过区(±190.8μm)。对于无萎缩、iRORA 和 cRORA 的 3 类分类,观察到中度一致性(AC=0.53)。探索性分析表明,使用(1)无萎缩;(2)内核层和外丛状层下沉,或低反射楔形带,作为较轻的萎缩程度;以及(3)在此基础上增加脉络膜高透过 250μm 或更多的要求作为更严重的萎缩程度,进行 3 类分类的一致性水平显著更高(AC=0.68;P=0.013)。
可以相对一致和稳健地进行 iRORA 和 cRORA 及其大多数相关特征的评估。定义早期萎缩的特征的精细组合可以进一步提高读者间一致性。