Department of Systems and Biomedical, Faculty of Engineering, Cairo University, Egypt.
Department of Neuromuscular Disorder and Its Surgery, Faculty of Physical Therapy, Cairo University, Giza, Egypt.
Biomed Phys Eng Express. 2024 Oct 9;10(6). doi: 10.1088/2057-1976/ad8094.
Facial paralysis (FP) is a condition characterized by the inability to move some or all of the muscles on one or both sides of the face. Diagnosing FP presents challenges due to the limitations of traditional methods, which are time-consuming, uncomfortable for patients, and require specialized clinicians. Additionally, more advanced tools are often uncommonly available to all healthcare providers. Early and accurate detection of FP is crucial, as timely intervention can prevent long-term complications and improve patient outcomes. To address these challenges, our research introduces Facia-Fix, a mobile application for Bell's palsy diagnosis, integrating computer vision and deep learning techniques to provide real-time analysis of facial landmarks. The classification algorithms are trained on the publicly available YouTube FP (YFP) dataset, which is labeled using the House-Brackmann (HB) method, a standardized system for assessing the severity of FP. Different deep learning models were employed to classify the FP severity, such as MobileNet, CNN, MLP, VGG16, and Vision Transformer. The MobileNet model which uses transfer learning, achieved the highest performance (Accuracy: 0.9812, Precision: 0.9753, Recall: 0.9727, F1 Score: 0.974), establishing it as the optimal choice among the evaluated models. The innovation of this approach lies in its use of advanced deep learning models to provide accurate, objective, non-invasive and real-time comprehensive quantitative assessment of FP severity. Preliminary results highlight the potential of Facia-Fix to significantly improve the diagnostic and follow-up experiences for both clinicians and patients.
面瘫(FP)是一种面部某些或所有肌肉无法运动的病症,单侧或双侧均可发生。由于传统方法存在耗时、患者不适和需要专业临床医生等局限性,诊断 FP 存在挑战。此外,更先进的工具通常并非所有医疗保健提供者都能普遍获得。早期和准确地检测 FP 至关重要,因为及时干预可以预防长期并发症并改善患者预后。为了解决这些挑战,我们的研究引入了 Facia-Fix,这是一种用于贝尔氏麻痹诊断的移动应用程序,它集成了计算机视觉和深度学习技术,实时分析面部标志。分类算法在公共的 YouTube FP(YFP)数据集上进行训练,该数据集使用 House-Brackmann(HB)方法进行标记,这是一种评估 FP 严重程度的标准化系统。不同的深度学习模型被用于分类 FP 的严重程度,例如 MobileNet、CNN、MLP、VGG16 和 Vision Transformer。使用迁移学习的 MobileNet 模型实现了最高性能(准确率:0.9812、精度:0.9753、召回率:0.9727、F1 得分:0.974),因此成为评估模型中最佳选择。这种方法的创新之处在于使用先进的深度学习模型,为 FP 严重程度提供准确、客观、非侵入性和实时的全面定量评估。初步结果突出了 Facia-Fix 为临床医生和患者带来显著改善诊断和随访体验的潜力。