University of Rijeka, Faculty of Engineering, Department of Computer Engineering, Vukovarska 58, Rijeka, 51000, Croatia; University of Rijeka, Center for Artificial Intelligence and Cybersecurity, Radmile Matejčić 2, Rijeka, 51000, Croatia.
Medical University of Graz, Department of Radiology, Division of Pediatric Radiology, Auenbruggerplatz 34, Graz, 8036, Austria.
Comput Biol Med. 2021 May;132:104300. doi: 10.1016/j.compbiomed.2021.104300. Epub 2021 Mar 3.
Computer-aided diagnosis relies on machine learning algorithms that require filtered and preprocessed data as the input. Aligning the image in the desired direction is an additional manual step in post-processing, commonly overlooked due to workload issues. Several state-of-the-art approaches for fracture detection and disease-struck region segmentation benefit from correctly oriented images, thus requiring such preprocessing of X-ray images. Furthermore, it is desirable to have archived studies in a standardized format. Radiograph hanging protocols also differ from case to case, which means that images are not always aligned and oriented correctly. As a solution, the paper proposes XAOM, an X-ray Alignment and Orientation Method for images from 21 different body regions.
Typically, other methods are crafted for this purpose to suit a specific body region and form of usage. In contrast, the method proposed in this paper is comprehensive and easily tuned to align and orient X-ray images of any body region. XAOM consists of two stages. For the first stage of the method, aligning X-ray images, we experimented with the following approaches: Hough transform, Fast line detection algorithm, and Principal Component Analysis method. For the second stage, we have experimented with the adaptations of several well known convolutional neural network topologies for correctly predicting image orientation: LeNet5, AlexNet, VGG16, VGG19, and ResNet50.
In the first stage, the PCA-based approach performed best. The average difference between the angle detected by the algorithm and the angle marked by the experts on the test set containing 200 pediatric X-ray images was 1.65, while the median value was 0.11. In the second stage, the VGG16-based network topology achieved the best accuracy of 0.993 on a test set containing 4,221 images.
XAOM is highly accurate at aligning and orienting pediatric X-ray images of 21 common body regions according to a set standard. The proposed method is also robust and can be easily adjusted to the different alignment and rotation criteria.
The Python source code of the best performing implementation of XAOM is publicly available at https://github.com/fhrzic/XAOM.
计算机辅助诊断依赖于机器学习算法,这些算法需要作为输入的过滤和预处理数据。在后续处理中,将图像调整到所需的方向是一个额外的手动步骤,由于工作量问题,通常会被忽略。几种用于骨折检测和患病区域分割的最先进方法都受益于正确定向的图像,因此需要对 X 射线图像进行这种预处理。此外,希望存档研究采用标准化格式。射线照片悬挂协议也因病例而异,这意味着图像并不总是正确对齐和定向的。为此,本文提出了 XAOM,这是一种针对 21 个不同身体区域的 X 射线的对齐和定向方法。
通常,为此目的定制了其他方法来适应特定的身体区域和使用形式。相比之下,本文提出的方法是全面的,并且易于调整以对齐和定向任何身体区域的 X 射线图像。XAOM 由两个阶段组成。对于第一阶段的 X 射线图像对齐,我们尝试了以下方法:Hough 变换、快速线检测算法和主成分分析方法。对于第二阶段,我们尝试了几种著名的卷积神经网络拓扑结构的改编,以正确预测图像方向:LeNet5、AlexNet、VGG16、VGG19 和 ResNet50。
在第一阶段,基于 PCA 的方法表现最好。在包含 200 张儿科 X 射线图像的测试集中,算法检测到的角度与专家标记的角度之间的平均差异为 1.65,中位数为 0.11。在第二阶段,基于 VGG16 的网络拓扑结构在包含 4221 张图像的测试集上达到了 0.993 的最佳精度。
XAOM 可以根据设定的标准高度准确地对齐和定向 21 个常见身体区域的儿科 X 射线图像。所提出的方法也很稳健,可以轻松调整以适应不同的对齐和旋转标准。
XAOM 的最佳实现的 Python 源代码可在 https://github.com/fhrzic/XAOM 上公开获取。