• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

利用语音实现的人工智能端到端阿尔茨海默病检测与评估

Artificial Intelligence-Enabled End-To-End Detection and Assessment of Alzheimer's Disease Using Voice.

作者信息

Agbavor Felix, Liang Hualou

机构信息

School of Biomedical Engineering, Science and Health Systems, Drexel University, Philadelphia, PA 19104, USA.

出版信息

Brain Sci. 2022 Dec 23;13(1):28. doi: 10.3390/brainsci13010028.

DOI:10.3390/brainsci13010028
PMID:36672010
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9856143/
Abstract

There is currently no simple, widely available screening method for Alzheimer's disease (AD), partly because the diagnosis of AD is complex and typically involves expensive and sometimes invasive tests not commonly available outside highly specialized clinical settings. Here, we developed an artificial intelligence (AI)-powered end-to-end system to detect AD and predict its severity directly from voice recordings. At the core of our system is the pre-trained data2vec model, the first high-performance self-supervised algorithm that works for speech, vision, and text. Our model was internally evaluated on the ADReSSo (Alzheimer's Dementia Recognition through Spontaneous Speech ) dataset containing voice recordings of subjects describing the Cookie Theft picture, and externally validated on a test dataset from DementiaBank. The AI model can detect AD with average area under the curve (AUC) of 0.846 and 0.835 on held-out and external test set, respectively. The model was well-calibrated (Hosmer-Lemeshow goodness-of-fit -value = 0.9616). Moreover, the model can reliably predict the subject's cognitive testing score solely based on raw voice recordings. Our study demonstrates the feasibility of using the AI-powered end-to-end model for early AD diagnosis and severity prediction directly based on voice, showing its potential for screening Alzheimer's disease in a community setting.

摘要

目前尚无简单且广泛可用的阿尔茨海默病(AD)筛查方法,部分原因在于AD的诊断复杂,通常需要昂贵且有时具有侵入性的检测,而这些检测在高度专业化的临床环境之外并不常见。在此,我们开发了一种由人工智能(AI)驱动的端到端系统,可直接从语音记录中检测AD并预测其严重程度。我们系统的核心是预训练的数据2vec模型,这是首个适用于语音、视觉和文本的高性能自监督算法。我们的模型在包含描述“偷饼干”图片的受试者语音记录的ADReSSo(通过自发语音识别阿尔茨海默病痴呆)数据集上进行了内部评估,并在来自痴呆症银行的测试数据集上进行了外部验证。该AI模型在保留测试集和外部测试集上检测AD的曲线下面积(AUC)平均值分别为0.846和0.835。该模型校准良好(Hosmer-Lemeshow拟合优度值 = 0.9616)。此外,该模型仅基于原始语音记录就能可靠地预测受试者的认知测试分数。我们的研究证明了使用由AI驱动的端到端模型直接基于语音进行AD早期诊断和严重程度预测的可行性,显示了其在社区环境中筛查阿尔茨海默病的潜力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/f8f7eb16bf2e/brainsci-13-00028-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/ed223fdeb890/brainsci-13-00028-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/17ea268830af/brainsci-13-00028-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/cdc36202533e/brainsci-13-00028-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/47f74f35e84c/brainsci-13-00028-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/d27126f3b229/brainsci-13-00028-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/f8f7eb16bf2e/brainsci-13-00028-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/ed223fdeb890/brainsci-13-00028-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/17ea268830af/brainsci-13-00028-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/cdc36202533e/brainsci-13-00028-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/47f74f35e84c/brainsci-13-00028-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/d27126f3b229/brainsci-13-00028-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/9324/9856143/f8f7eb16bf2e/brainsci-13-00028-g006.jpg

相似文献

1
Artificial Intelligence-Enabled End-To-End Detection and Assessment of Alzheimer's Disease Using Voice.利用语音实现的人工智能端到端阿尔茨海默病检测与评估
Brain Sci. 2022 Dec 23;13(1):28. doi: 10.3390/brainsci13010028.
2
Predicting dementia from spontaneous speech using large language models.使用大语言模型从自发语言中预测痴呆症。
PLOS Digit Health. 2022 Dec 22;1(12):e0000168. doi: 10.1371/journal.pdig.0000168. eCollection 2022 Dec.
3
A deep learning model for detection of Alzheimer's disease based on retinal photographs: a retrospective, multicentre case-control study.基于视网膜照片的阿尔茨海默病检测深度学习模型:一项回顾性、多中心病例对照研究。
Lancet Digit Health. 2022 Nov;4(11):e806-e815. doi: 10.1016/S2589-7500(22)00169-8. Epub 2022 Sep 30.
4
Leveraging speech and artificial intelligence to screen for early Alzheimer's disease and amyloid beta positivity.利用语音和人工智能筛查早期阿尔茨海默病及β-淀粉样蛋白阳性情况。
Brain Commun. 2022 Oct 14;4(5):fcac231. doi: 10.1093/braincomms/fcac231. eCollection 2022.
5
Applications of artificial intelligence to aid early detection of dementia: A scoping review on current capabilities and future directions.人工智能在痴呆症早期检测中的应用:当前能力和未来方向的范围综述。
J Biomed Inform. 2022 Mar;127:104030. doi: 10.1016/j.jbi.2022.104030. Epub 2022 Feb 17.
6
Development of a novel dementia risk prediction model in the general population: A large, longitudinal, population-based machine-learning study.普通人群中新型痴呆风险预测模型的开发:一项基于人群的大型纵向机器学习研究。
EClinicalMedicine. 2022 Sep 23;53:101665. doi: 10.1016/j.eclinm.2022.101665. eCollection 2022 Nov.
7
Efficient Pause Extraction and Encode Strategy for Alzheimer's Disease Detection Using Only Acoustic Features from Spontaneous Speech.仅使用自发语音的声学特征进行阿尔茨海默病检测的高效停顿提取与编码策略
Brain Sci. 2023 Mar 11;13(3):477. doi: 10.3390/brainsci13030477.
8
Exploring Deep Transfer Learning Techniques for Alzheimer's Dementia Detection.探索用于阿尔茨海默病痴呆检测的深度迁移学习技术。
Front Comput Sci. 2021 May;3. doi: 10.3389/fcomp.2021.624683. Epub 2021 May 12.
9
Prediction of Alzheimer's disease progression within 6 years using speech: A novel approach leveraging language models.利用语音预测 6 年内阿尔茨海默病的进展:一种利用语言模型的新方法。
Alzheimers Dement. 2024 Aug;20(8):5262-5270. doi: 10.1002/alz.13886. Epub 2024 Jun 25.
10
Objectively Quantifying Pediatric Psychiatric Severity Using Artificial Intelligence, Voice Recognition Technology, and Universal Emotions: Pilot Study for Artificial Intelligence-Enabled Innovation to Address Youth Mental Health Crisis.利用人工智能、语音识别技术和通用情感客观量化儿科精神疾病严重程度:基于人工智能的创新解决青少年心理健康危机的试点研究
JMIR Res Protoc. 2023 Oct 23;12:e51912. doi: 10.2196/51912.

引用本文的文献

1
Algorithmic Classification of Psychiatric Disorder-Related Spontaneous Communication Using Large Language Model Embeddings: Algorithm Development and Validation.使用大语言模型嵌入对精神障碍相关自发交流进行算法分类:算法开发与验证
JMIR AI. 2025 May 30;4:e67369. doi: 10.2196/67369.
2
Early Alzheimer's Detection Through Voice Analysis: Harnessing Locally Deployable LLMs via , a privacy-preserving diagnostic system.通过语音分析早期检测阿尔茨海默病:利用可本地部署的大语言模型构建一个隐私保护诊断系统。
AMIA Jt Summits Transl Sci Proc. 2025 Jun 10;2025:365-374. eCollection 2025.
3
Utility of artificial intelligence-based conversation voice analysis for detecting cognitive decline.

本文引用的文献

1
Predicting dementia from spontaneous speech using large language models.使用大语言模型从自发语言中预测痴呆症。
PLOS Digit Health. 2022 Dec 22;1(12):e0000168. doi: 10.1371/journal.pdig.0000168. eCollection 2022 Dec.
2
Advances in Alzheimer's disease research over the past two decades.过去二十年阿尔茨海默病研究的进展。
Lancet Neurol. 2022 Oct;21(10):866-869. doi: 10.1016/S1474-4422(22)00298-8.
3
Automated detection of mild cognitive impairment and dementia from voice recordings: A natural language processing approach.
基于人工智能的对话语音分析在检测认知衰退方面的效用。
PLoS One. 2025 Jun 2;20(6):e0325177. doi: 10.1371/journal.pone.0325177. eCollection 2025.
4
Alzheimer's disease recognition based on waveform and spectral speech signal processing.基于波形和频谱语音信号处理的阿尔茨海默病识别
Biomed Eng Lett. 2024 Nov 28;15(1):261-272. doi: 10.1007/s13534-024-00444-6. eCollection 2025 Jan.
5
Multilingual Prediction of Cognitive Impairment with Large Language Models and Speech Analysis.使用大语言模型和语音分析对认知障碍进行多语言预测
Brain Sci. 2024 Dec 22;14(12):1292. doi: 10.3390/brainsci14121292.
6
Analysis of Speech Features in Alzheimer's Disease with Machine Learning: A Case-Control Study.基于机器学习的阿尔茨海默病语音特征分析:一项病例对照研究。
Healthcare (Basel). 2024 Nov 4;12(21):2194. doi: 10.3390/healthcare12212194.
7
Digital detection of Alzheimer's disease using smiles and conversations with a chatbot.利用微笑和与聊天机器人的对话来进行阿尔茨海默病的数字检测。
Sci Rep. 2024 Nov 1;14(1):26309. doi: 10.1038/s41598-024-77220-0.
8
Early diagnosis of Alzheimer's Disease based on multi-attention mechanism.基于多注意力机制的阿尔茨海默病早期诊断。
PLoS One. 2024 Sep 24;19(9):e0310966. doi: 10.1371/journal.pone.0310966. eCollection 2024.
9
Advances in artificial intelligence for diagnosing Alzheimer's disease through speech.通过语音诊断阿尔茨海默病的人工智能进展。
Ann Med Surg (Lond). 2024 May 20;86(7):3822-3823. doi: 10.1097/MS9.0000000000002200. eCollection 2024 Jul.
10
A Comprehensive Review on Synergy of Multi-Modal Data and AI Technologies in Medical Diagnosis.多模态数据与人工智能技术在医学诊断中的协同作用综合综述
Bioengineering (Basel). 2024 Feb 25;11(3):219. doi: 10.3390/bioengineering11030219.
基于自然语言处理的语音记录分析技术在轻度认知障碍和痴呆症中的自动检测
Alzheimers Dement. 2023 Mar;19(3):946-955. doi: 10.1002/alz.12721. Epub 2022 Jul 7.
4
Combining Multimodal Behavioral Data of Gait, Speech, and Drawing for Classification of Alzheimer's Disease and Mild Cognitive Impairment.联合步态、言语和绘画的多模态行为数据进行阿尔茨海默病和轻度认知障碍的分类。
J Alzheimers Dis. 2021;84(1):315-327. doi: 10.3233/JAD-210684.
5
Identification of digital voice biomarkers for cognitive health.识别认知健康的数字语音生物标志物。
Explor Med. 2020;1:406-417. doi: 10.37349/emed.2020.00028. Epub 2020 Dec 31.
6
Linguistic markers predict onset of Alzheimer's disease.语言标记可预测阿尔茨海默病的发病。
EClinicalMedicine. 2020 Oct 22;28:100583. doi: 10.1016/j.eclinm.2020.100583. eCollection 2020 Nov.
7
Artificial Intelligence, Speech, and Language Processing Approaches to Monitoring Alzheimer's Disease: A Systematic Review.人工智能、语音和语言处理方法在阿尔茨海默病监测中的应用:系统综述。
J Alzheimers Dis. 2020;78(4):1547-1574. doi: 10.3233/JAD-200888.
8
Economic burden of Alzheimer disease and managed care considerations.阿尔茨海默病的经济负担和管理式医疗考虑因素。
Am J Manag Care. 2020 Aug;26(8 Suppl):S177-S183. doi: 10.37765/ajmc.2020.88482.
9
Current and Future Treatments in Alzheimer Disease: An Update.阿尔茨海默病的当前及未来治疗方法:最新进展
J Cent Nerv Syst Dis. 2020 Feb 29;12:1179573520907397. doi: 10.1177/1179573520907397. eCollection 2020.
10
Early diagnosis of Alzheimer's disease using combined features from voxel-based morphometry and cortical, subcortical, and hippocampus regions of MRI T1 brain images.基于体素形态测量学和 MRI T1 脑图像的皮质、皮质下和海马区的联合特征对阿尔茨海默病的早期诊断。
PLoS One. 2019 Oct 4;14(10):e0222446. doi: 10.1371/journal.pone.0222446. eCollection 2019.