Kang Yang-Jae, Yoo Jun-Il, Cha Yong-Han, Park Chan H, Kim Jung-Taek
Division of Applied Life Science Department at Gyeongsang National University, PMBBRC, Jinju, Republic of Korea.
Division of Life Science Department at Gyeongsang National University, Jinju, Republic of Korea.
J Orthop Translat. 2019 Dec 20;21:13-17. doi: 10.1016/j.jot.2019.11.004. eCollection 2020 Mar.
The purposes of this study were to develop a machine learning-based implant recognition program and to verify its accuracy.
Postoperative anteroposterior (AP) X-rays (≥300 dpi) were collected of patients who underwent total hip arthroplasty. X-rays with a wire or plate added and those without a true anteroposterior view were excluded. A total of 170 X-ray images of hip implants from 29 brands were collected from five hospitals and a Google image search. These collected images were manually reorganised to ensure appropriate labelling. Collected images were preprocessed to have grey-scaled pixels with histogram equalisation for efficient training. Images varied by +10/-10°, and 3606 unique images derived from the original 170 images were created for training. Discussion of the validation set being derived 25% of training set. The recognition model structure consisted of two steps: object detection and clustering. Model training was performed with Keras deep learning platform.
The 170 X-ray images of hip implants were used to build a stem detection model using YOLOv3. Manually labelled images were successfully trained into the stem detection model. Evaluation of 58 newly labelled X-ray images showed highly accurate stem detection (mean average precision > 0.99). Fully connected layers generated 29 class outputs. After training, a receiver operating characteristic curve was generated with a test set containing 25% of all stem-cropped images, yielding an area under the curve of 0.99.
Femoral stem identification in patients with total hip arthroplasty was very accurate. This technology could be used to collect large-scale implant information.
This program has the following clinical relevance. First, we can prepare the implants needed for revision surgery by identifying the old types of implants. Second, it can be used to diagnose peripheral osteolysis or periprosthetic fracture by further developing the ability to sensitise implant detection. Third, an automated implant detection system will help organise imaging data systematically and easily for arthroplasty registry construction.
本研究的目的是开发一种基于机器学习的植入物识别程序并验证其准确性。
收集接受全髋关节置换术患者的术后前后位(AP)X线片(≥300 dpi)。排除添加了钢丝或钢板的X线片以及没有真正前后位视图的X线片。从五家医院和谷歌图片搜索中收集了来自29个品牌的总共170张髋关节植入物X线图像。对这些收集到的图像进行手动整理以确保适当标注。对收集到的图像进行预处理,使其具有经过直方图均衡化的灰度像素,以进行高效训练。图像以±10°变化,从原始的170张图像中生成3606张独特图像用于训练。讨论了验证集占训练集的25%。识别模型结构包括两个步骤:目标检测和聚类。使用Keras深度学习平台进行模型训练。
使用170张髋关节植入物X线图像构建了基于YOLOv3的柄部检测模型。手动标注的图像成功训练成柄部检测模型。对58张新标注的X线图像进行评估,结果显示柄部检测具有高度准确性(平均精度>0.99)。全连接层生成29个类别输出。训练后,使用包含所有柄部裁剪图像25%的测试集生成了受试者工作特征曲线,曲线下面积为0.99。
全髋关节置换术患者的股骨柄识别非常准确。该技术可用于收集大规模植入物信息。
该程序具有以下临床意义。首先,我们可以通过识别旧类型的植入物来准备翻修手术所需的植入物。其次,通过进一步提高植入物检测敏感性的能力,可用于诊断周围骨溶解或假体周围骨折。第三,自动化植入物检测系统将有助于系统且轻松地整理成像数据以构建关节置换登记册。