Center for Intelligent Imaging, University of California, 1700 4th Street, San Francisco, CA 94158, United States of America.
Center for Intelligent Imaging, University of California, 1700 4th Street, San Francisco, CA 94158, United States of America; Computer Science Division, UC Berkeley, 387 Soda Hall #1776 Berkeley, CA 94720, United States of America.
Med Image Anal. 2022 Apr;77:102388. doi: 10.1016/j.media.2022.102388. Epub 2022 Feb 7.
Bone shape changes are considered a relevant biomarker in understanding the onset and progression of knee osteoarthritis (OA). This study used a novel deep learning pipeline to predict longitudinal bone shape changes in the femur four years in advance, using bone surfaces that were extracted in knee MRIs from the OA initiative study, via a segmentation procedure and encoded as shape maps using spherical coordinates. Given a sequence of three consecutive shape maps (collected in a time window of 24 months), a fully convolutional network was trained to predict the whole bone surface 48 months after the last observed time point, and a classifier to diagnose OA in the predicted maps. For this, a novel multi-term loss function, based on contrastive learning was designed. Experimental results show that the model predicted shape changes with an L error comparable to the MRI slice thickness (0.7mm). Next, an ablation study demonstrated that the introduction of a contrastive term in the loss improved sensitivity of the OA classifier, increasing sensitivity from 0.537 to 0.709, just shy of the upper bound of 0.740 computed on the ground truth bone shape maps. Our approach provides a promising tool, suitable for patient specific OA trajectory analysis.
骨骼形状变化被认为是理解膝关节骨关节炎(OA)发病和进展的一个相关生物标志物。本研究使用一种新颖的深度学习管道,通过分割程序从 OA 倡议研究中的膝关节 MRI 中提取骨骼表面,并使用球坐标将其编码为形状图,从而预测股骨的纵向骨骼形状变化,可提前四年。给定三个连续的形状图序列(在 24 个月的时间窗口内收集),使用全卷积网络对最后一次观察时间点后 48 个月的整个骨骼表面进行预测,并使用分类器对预测的图像进行 OA 诊断。为此,设计了一种基于对比学习的新型多项损失函数。实验结果表明,该模型预测的形状变化与 MRI 切片厚度(0.7mm)相当,L 误差。接下来,一项消融研究表明,在损失中引入对比项可以提高 OA 分类器的灵敏度,从 0.537 增加到 0.709,仅略低于基于真实骨骼形状图计算的 0.740 的上限。我们的方法提供了一种有前途的工具,适合用于患者特定的 OA 轨迹分析。