Lo Lun-Jou, Yang Chao-Tung, Ho Cheng-Ting, Liao Chun-Hao, Lin Hsiu-Hsia
From the Department of Plastic and Reconstructive Surgery, and Craniofacial Research Center, Chang Gung Memorial Hospital, Chang Gung University, Taoyuan.
Department of Computer Science, Tunghai University, Taichung.
Ann Plast Surg. 2021 Mar 1;86(3S Suppl 2):S224-S228. doi: 10.1097/SAP.0000000000002687.
An objective and quantitative assessment of facial symmetry is essential for the surgical planning and evaluation of treatment outcomes in orthognathic surgery (OGS). This study applied the transfer learning model with a convolutional neural network based on 3-dimensional (3D) contour line features to evaluate the facial symmetry before and after OGS.
A total of 158 patients were recruited in a retrospective cohort study for the assessment and comparison of facial symmetry before and after OGS from January 2018 to March 2020. Three-dimensional facial photographs were captured by the 3dMD face system in a natural head position, with eyes looking forward, relaxed facial muscles, and habitual dental occlusion before and at least 6 months after surgery. Three-dimensional contour images were extracted from 3D facial images for the subsequent Web-based automatic assessment of facial symmetry by using the transfer learning with a convolutional neural network model.
The mean score of postoperative facial symmetry showed significant improvements from 2.74 to 3.52, and the improvement degree of facial symmetry (in percentage) after surgery was 21% using the constructed machine learning model. A Web-based system provided a user-friendly interface and quick assessment results for clinicians and was an effective doctor-patient communication tool.
This work was the first attempt to automatically assess the facial symmetry before and after surgery in an objective and quantitative value by using a machine learning model based on the 3D contour feature map.
对面部对称性进行客观定量评估对于正颌外科手术(OGS)的手术规划和治疗效果评估至关重要。本研究应用基于三维(3D)轮廓线特征的卷积神经网络迁移学习模型来评估正颌外科手术前后的面部对称性。
在一项回顾性队列研究中,共招募了158例患者,以评估和比较2018年1月至2020年3月期间正颌外科手术前后的面部对称性。通过3dMD面部系统在自然头位下拍摄三维面部照片,术前和术后至少6个月时,眼睛向前看,面部肌肉放松,保持习惯性牙合。从三维面部图像中提取三维轮廓图像,随后使用基于卷积神经网络模型的迁移学习,通过网络对面部对称性进行自动评估。
术后面部对称性的平均得分从2.74显著提高到3.52,使用构建的机器学习模型,术后面部对称性的改善程度(百分比)为21%。一个基于网络的系统为临床医生提供了用户友好的界面和快速的评估结果,是一种有效的医患沟通工具。
本研究首次尝试使用基于3D轮廓特征图的机器学习模型,以客观定量的数值自动评估手术前后的面部对称性。