Baray Sriman Bidhan, Abdelmoniem Mohamed, Mahmud Sakib, Kabir Saidul, Faisal Md Ahasan Atick, Chowdhury Muhammad E H, Abbas Tariq O
Department of Electrical and Electronic Engineering, University of Dhaka, Dhaka, Bangladesh.
Department of Electrical Engineering, College of Engineering, Qatar University, Doha, Qatar.
Front Pediatr. 2023 Apr 17;11:1149318. doi: 10.3389/fped.2023.1149318. eCollection 2023.
Develop a reliable, automated deep learning-based method for accurate measurement of penile curvature (PC) using 2-dimensional images.
A set of nine 3D-printed models was used to generate a batch of 913 images of penile curvature (PC) with varying configurations (curvature range 18° to 86°). The penile region was initially localized and cropped using a YOLOv5 model, after which the shaft area was extracted using a UNet-based segmentation model. The penile shaft was then divided into three distinct predefined regions: the distal zone, curvature zone, and proximal zone. To measure PC, we identified four distinct locations on the shaft that reflected the mid-axes of proximal and distal segments, then trained an HRNet model to predict these landmarks and calculate curvature angle in both the 3D-printed models and masked segmented images derived from these. Finally, the optimized HRNet model was applied to quantify PC in medical images of real human patients and the accuracy of this novel method was determined.
We obtained a mean absolute error (MAE) of angle measurement <5° for both penile model images and their derivative masks. For real patient images, AI prediction varied between 1.7° (for cases of ∼30° PC) and approximately 6° (for cases of 70° PC) compared with assessment by a clinical expert.
This study demonstrates a novel approach to the automated, accurate measurement of PC that could significantly improve patient assessment by surgeons and hypospadiology researchers. This method may overcome current limitations encountered when applying conventional methods of measuring arc-type PC.
开发一种可靠的、基于深度学习的自动化方法,用于使用二维图像准确测量阴茎弯曲度(PC)。
使用一组九个3D打印模型生成一批913张具有不同配置(弯曲度范围18°至86°)的阴茎弯曲(PC)图像。首先使用YOLOv5模型对阴茎区域进行定位和裁剪,然后使用基于UNet的分割模型提取阴茎干区域。然后将阴茎干分为三个不同的预定义区域:远端区域、弯曲区域和近端区域。为了测量PC,我们在阴茎干上确定了四个不同的位置,这些位置反映了近端和远端节段的中轴线,然后训练一个HRNet模型来预测这些标志点,并计算3D打印模型及其衍生的掩码分割图像中的弯曲角度。最后,将优化后的HRNet模型应用于量化真实人类患者的医学图像中的PC,并确定这种新方法的准确性。
对于阴茎模型图像及其衍生掩码,我们获得的角度测量平均绝对误差(MAE)<5°。对于真实患者图像,与临床专家的评估相比,人工智能预测在1.7°(对于约30°PC的病例)至约6°(对于70°PC的病例)之间变化。
本研究展示了一种自动化、准确测量PC的新方法,这可以显著改善外科医生和尿道下裂研究人员对患者的评估。该方法可能克服应用传统方法测量弧形PC时遇到的当前局限性。