IEEE Trans Med Imaging. 2014 Apr;33(4):797-813. doi: 10.1109/TMI.2013.2276943. Epub 2013 Aug 6.
This paper presents the evaluation results of the methods submitted to Challenge US: Biometric Measurements from Fetal Ultrasound Images, a segmentation challenge held at the IEEE International Symposium on Biomedical Imaging 2012. The challenge was set to compare and evaluate current fetal ultrasound image segmentation methods. It consisted of automatically segmenting fetal anatomical structures to measure standard obstetric biometric parameters, from 2D fetal ultrasound images taken on fetuses at different gestational ages (21 weeks, 28 weeks, and 33 weeks) and with varying image quality to reflect data encountered in real clinical environments. Four independent sub-challenges were proposed, according to the objects of interest measured in clinical practice: abdomen, head, femur, and whole fetus. Five teams participated in the head sub-challenge and two teams in the femur sub-challenge, including one team who tackled both. Nobody attempted the abdomen and whole fetus sub-challenges. The challenge goals were two-fold and the participants were asked to submit the segmentation results as well as the measurements derived from the segmented objects. Extensive quantitative (region-based, distance-based, and Bland-Altman measurements) and qualitative evaluation was performed to compare the results from a representative selection of current methods submitted to the challenge. Several experts (three for the head sub-challenge and two for the femur sub-challenge), with different degrees of expertise, manually delineated the objects of interest to define the ground truth used within the evaluation framework. For the head sub-challenge, several groups produced results that could be potentially used in clinical settings, with comparable performance to manual delineations. The femur sub-challenge had inferior performance to the head sub-challenge due to the fact that it is a harder segmentation problem and that the techniques presented relied more on the femur's appearance.
本文呈现了提交给挑战 US 的方法的评估结果：来自胎儿超声图像的生物特征测量，这是在 2012 年 IEEE 生物医学成像国际研讨会上举行的一个分割挑战。该挑战旨在比较和评估当前的胎儿超声图像分割方法。它包括自动分割胎儿解剖结构，以测量标准产科生物测量参数，这些参数来自在不同胎龄（21 周、28 周和 33 周）和不同图像质量下拍摄的胎儿的 2D 胎儿超声图像，以反映实际临床环境中遇到的数据。根据在临床实践中测量的感兴趣的对象，提出了四个独立的子挑战：腹部、头部、股骨和整个胎儿。有五个团队参加了头部子挑战，两个团队参加了股骨子挑战，其中一个团队同时参加了这两个挑战。没有人尝试腹部和整个胎儿子挑战。挑战的目标有两个，要求参与者提交分割结果以及从分割对象中得出的测量值。进行了广泛的定量（基于区域、基于距离和 Bland-Altman 测量）和定性评估，以比较向挑战提交的当前方法的代表性选择的结果。几位专家（三位参加头部子挑战，两位参加股骨子挑战），具有不同程度的专业知识，手动描绘了感兴趣的对象，以定义评估框架中使用的真实值。对于头部子挑战，有几个小组的结果可能在临床环境中使用，其性能与手动描绘相当。股骨子挑战的性能不如头部子挑战，因为这是一个更难的分割问题，而且提出的技术更多地依赖于股骨的外观。
