Wanyonyi S Z, Napolitano R, Ohuma E O, Salomon L J, Papageorghiou A T
Nuffield Department of Obstetrics & Gynaecology, University of Oxford, John Radcliffe Hospital, Oxford, UK.
Ultrasound Obstet Gynecol. 2014 Dec;44(6):649-54. doi: 10.1002/uog.13376.
To develop and evaluate an objective image-scoring system for crown-rump length (CRL) measurements and to determine how this compares with subjective assessment.
A total of 125 CRL ultrasound images were selected from the database of the International Fetal and Newborn Growth Consortium for the 21(st) Century study group. Two reviewers, who were blinded to the operators' and to each others' results, evaluated all images both subjectively and objectively. Subjective evaluation consisted of rating an image as acceptable or unacceptable, while objective evaluation was based on six criteria. Reviewer differences for both the subjective and objective evaluations were compared using percentage of agreement and adjusted kappa values.
The distribution of individual scores and differences between subjective and objective evaluation for the two reviewers was similar. Overall agreement between the reviewers was higher for objective evaluation (95.2%; adjusted κ, 0.904), than for subjective evaluation (77.6%; adjusted κ, 0.552). There was a high level of agreement for horizontal position (κ = 0.951), magnification (κ = 0.919), visualization of crown and rump (κ = 0.806) and caliper placement (κ = 0.756), while agreement for mid-sagittal section (κ = 0.629) and neutral position (κ = 0.565) were moderate and poor, respectively.
The proposed six-point scoring system for CRL image rating is more reproducible than is subjective evaluation and should be considered as a method of quality assessment and audit.
开发并评估一种用于头臀长(CRL)测量的客观图像评分系统,并确定其与主观评估相比的情况。
从21世纪国际胎儿与新生儿生长联盟研究组的数据库中选取了125张CRL超声图像。两名对操作者结果及彼此结果不知情的审阅者,对所有图像进行主观和客观评估。主观评估包括将图像评为可接受或不可接受,而客观评估基于六个标准。使用一致率和调整后的kappa值比较两位审阅者在主观和客观评估中的差异。
两位审阅者的个人评分分布以及主观和客观评估之间的差异相似。审阅者之间在客观评估方面的总体一致性(95.2%;调整后的κ值为0.904)高于主观评估(77.6%;调整后的κ值为0.552)。在水平位置(κ = 0.951)、放大倍数(κ = 0.919)、头臀可视化(κ = 0.806)和卡尺放置(κ = 0.756)方面一致性较高,而在正中矢状切面(κ = 0.629)和中立位置(κ = 0.565)方面一致性分别为中等和较差。
所提出的用于CRL图像评分的六点评分系统比主观评估更具可重复性,应被视为一种质量评估和审核方法。