Gobira Mauro, Nakayama Luis F, Regatieri Caio Vinicius S, Belfort Rubens
Ophthalmology, Vision Institute - Instituto Paulista de Estudos e Pesquisas em Oftalmologia (IPEPO), São Paulo, BRA.
Ophthalmology, Universidade Federal de São Paulo (UNIFESP), São Paulo, BRA.
Cureus. 2025 Mar 24;17(3):e81064. doi: 10.7759/cureus.81064. eCollection 2025 Mar.
PURPOSE: This study compares the performance of two no-code machine learning platforms, Google's Teachable Machine (TM) (Google LLC, Mountain View, CA, USA) and Apple's Create ML (Apple Inc., Cupertino, CA, USA), alongside a traditional deep learning model, ResNet200d, in classifying optic nerve fundus images into glaucoma and non-glaucoma categories using the ACRIMA dataset. METHODS: A comparative cross-sectional analysis was conducted using 705 labeled fundus images from the ACRIMA dataset (326 glaucomatous, 239 non-glaucomatous). Models were trained separately on each platform, and a validation set comprising 70 glaucomatous and 70 non-glaucomatous images was used to assess performance. Performance metrics, such as sensitivity, specificity, F1 score, and Cohen's kappa, were assessed with 95% confidence intervals. Statistical analysis was performed using DATAtab (DATAtab e.U. Graz, Austria (https://datatab.net)). RESULTS: The ResNet200d model demonstrated the highest performance, with an accuracy of 99.29%, a sensitivity of 98.57%, a specificity of 100%, and an F1 score of 99.29%. Create ML achieved a sensitivity of 93.24%, a specificity of 98.48%, and an F1 score of 95.83%. TM exhibited a sensitivity of 95.71%, a specificity of 94.29%, and an F1 score of 95.04%. Both no-code platforms demonstrated strong performance, with Create ML excelling in specificity and TM showing higher sensitivity. CONCLUSION: While the ResNet200d model outperformed both no-code platforms in diagnostic accuracy, the no-code platforms demonstrated robust capabilities, highlighting their potential to democratize artificial intelligence (AI) in healthcare. These results highlight the potential of no-code platforms for democratizing medical image analysis, especially in resource-limited contexts. Further studies with diverse datasets are recommended to validate these results.
目的:本研究比较了两个无代码机器学习平台,即谷歌的可教机器(TM)(谷歌有限责任公司,美国加利福尼亚州山景城)和苹果的创建机器学习(苹果公司,美国加利福尼亚州库比蒂诺),与传统深度学习模型ResNet200d,在使用ACRIMA数据集将视神经眼底图像分类为青光眼和非青光眼类别方面的性能。 方法:使用来自ACRIMA数据集的705张标记眼底图像(326张青光眼图像,239张非青光眼图像)进行了一项比较横断面分析。模型在每个平台上分别进行训练,并使用包含70张青光眼图像和70张非青光眼图像的验证集来评估性能。性能指标,如敏感性、特异性、F1分数和科恩kappa系数,以95%置信区间进行评估。使用DATAtab(DATAtab e.U.,奥地利格拉茨(https://datatab.net))进行统计分析。 结果:ResNet200d模型表现出最高性能,准确率为99.29%,敏感性为98.57%,特异性为100%,F1分数为99.29%。创建机器学习的敏感性为93.24%,特异性为98.48%,F1分数为95.83%。TM的敏感性为95.71%,特异性为94.29%,F1分数为95.04%。两个无代码平台都表现出强大的性能,创建机器学习在特异性方面表现出色,而TM显示出更高的敏感性。 结论:虽然ResNet200d模型在诊断准确性方面优于两个无代码平台,但无代码平台展示了强大的能力,突出了它们在医疗保健领域使人工智能(AI)民主化的潜力。这些结果凸显了无代码平台在使医学图像分析民主化方面的潜力,特别是在资源有限的情况下。建议使用不同数据集进行进一步研究以验证这些结果。
Graefes Arch Clin Exp Ophthalmol. 2020-4
Ophthalmol Sci. 2025-1-30
Microsc Res Tech. 2022-6
Ophthalmol Sci. 2024-11-29
Ophthalmol Glaucoma. 2018
J Ophthalmic Vis Res. 2024-9-16
J Ophthalmic Vis Res. 2023-2-21
Biomed Eng Online. 2019-3-20