Department of Biomedical Engineering and Center for Biotechnology and Interdisciplinary Studies, Rensselaer Polytechnic Institute, Troy, NY, 12180, USA.
Department of Oral and Maxillofacial Surgery, Houston Methodist Research Institute, Houston, TX, 77030, USA.
Int J Comput Assist Radiol Surg. 2022 May;17(5):945-952. doi: 10.1007/s11548-022-02596-1. Epub 2022 Apr 1.
Orthognathic surgery requires an accurate surgical plan of how bony segments are moved and how the face passively responds to the bony movement. Currently, finite element method (FEM) is the standard for predicting facial deformation. Deep learning models have recently been used to approximate FEM because of their faster simulation speed. However, current solutions are not compatible with detailed facial meshes and often do not explicitly provide the network with known boundary type information. Therefore, the purpose of this proof-of-concept study is to develop a biomechanics-informed deep neural network that accepts point cloud data and explicit boundary types as inputs to the network for fast prediction of soft-tissue deformation.
A deep learning network was developed based on the PointNet++ architecture. The network accepts the starting facial mesh, input displacement, and explicit boundary type information and predicts the final facial mesh deformation.
We trained and tested our deep learning model on datasets created from FEM simulations of facial meshes. Our model achieved a mean error between 0.159 and 0.642 mm on five subjects. Including explicit boundary types had mixed results, improving performance in simulations with large deformations but decreasing performance in simulations with small deformations. These results suggest that including explicit boundary types may not be necessary to improve network performance.
Our deep learning method can approximate FEM for facial change prediction in orthognathic surgical planning by accepting geometrically detailed meshes and explicit boundary types while significantly reducing simulation time.
正颌手术需要准确的手术计划,以确定骨段如何移动以及面部如何被动响应骨移动。目前,有限元方法(FEM)是预测面部变形的标准。由于深度学习模型具有更快的模拟速度,因此最近已被用于近似 FEM。但是,当前的解决方案与详细的面部网格不兼容,并且通常不会明确向网络提供已知边界类型信息。因此,本概念验证研究的目的是开发一种基于生物力学的深度神经网络,该网络接受点云数据和显式边界类型作为网络的输入,以快速预测软组织变形。
基于 PointNet++ 架构开发了深度学习网络。该网络接受初始面部网格,输入位移和显式边界类型信息,并预测最终面部网格变形。
我们在基于面部网格的 FEM 模拟创建的数据集上对我们的深度学习模型进行了训练和测试。我们的模型在五个受试者上的平均误差在 0.159 到 0.642 毫米之间。包含显式边界类型的结果好坏参半,在大变形模拟中提高了性能,但在小变形模拟中降低了性能。这些结果表明,包含显式边界类型可能不是提高网络性能所必需的。
我们的深度学习方法可以通过接受几何上详细的网格和显式边界类型来近似 FEM,从而预测正颌手术计划中的面部变化,同时大大减少模拟时间。