Yang Jiancheng, Shi Rui, Jin Liang, Huang Xiaoyang, Kuang Kaiming, Wei Donglai, Gu Shixuan, Liu Jianying, Liu Pengfei, Chai Zhizhong, Xiao Yongjie, Chen Hao, Xu Liming, Du Bang, Yan Xiangyi, Tang Hao, Alessio Adam, Holste Gregory, Zhang Jiapeng, Wang Xiaoming, He Jianye, Che Lixuan, Pfister Hanspeter, Li Ming, Ni Bingbing
IEEE Trans Med Imaging. 2025 Aug;44(8):3410-3427. doi: 10.1109/TMI.2025.3565514.
Rib fractures are a common and potentially severe injury that can be challenging and labor-intensive to detect in CT scans. While there have been efforts to address this field, the lack of large-scale annotated datasets and evaluation benchmarks has hindered the development and validation of deep learning algorithms. To address this issue, the RibFrac Challenge was introduced, providing a benchmark dataset of over 5,000 rib fractures from 660 CT scans, with voxel-level instance mask annotations and diagnosis labels for four clinical categories (buckle, nondisplaced, displaced, or segmental). The challenge includes two tracks: a detection (instance segmentation) track evaluated by an FROC-style metric and a classification track evaluated by an F1-style metric. During the MICCAI 2020 challenge period, 243 results were evaluated, and seven teams were invited to participate in the challenge summary. The analysis revealed that several top rib fracture detection solutions achieved performance comparable or even better than human experts. Nevertheless, the current rib fracture classification solutions are hardly clinically applicable, which can be an interesting area in the future. As an active benchmark and research resource, the data and online evaluation of the RibFrac Challenge are available at the challenge website (https://ribfrac.grand-challenge.org/). In addition, we further analyzed the impact of two post-challenge advancements-large-scale pretraining and rib segmentation-based on our internal baseline for rib fracture detection. These findings lay a foundation for future research and development in AI-assisted rib fracture diagnosis.