文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

Evaluation of large language models on mental health: from knowledge test to illness diagnosis.

作者信息

Xu Yijun, Fang Zhaoxi, Lin Weinan, Jiang Yue, Jin Wen, Balaji Prasanalakshmi, Wang Jiangda, Xia Ting

机构信息

Department of Computer Science and Engineering, Shaoxing University, Shaoxing, China.

Institute of Artificial Intelligence, Shaoxing University, Shaoxing, China.

出版信息

Front Psychiatry. 2025 Aug 6;16:1646974. doi: 10.3389/fpsyt.2025.1646974. eCollection 2025.


DOI:10.3389/fpsyt.2025.1646974
PMID:40842952
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC12365771/
Abstract

Large language models (LLMs) have opened up new possibilities in the field of mental health, offering applications in areas such as mental health assessment, psychological counseling, and education. This study systematically evaluates 15 state-of-the-art LLMs, including DeepSeekR1/V3 (March 24, 2025), GPT-4.1 (April 15, 2025), Llama4 (April 5, 2025), and QwQ (March 6, 2025, developed by Alibaba), on two key tasks: mental health knowledge testing and mental illness diagnosis in the Chinese context. We use publicly available datasets, including Dreaddit, SDCNL, and questions from the CAS Counsellor Qualification Exam. Results indicate that DeepSeek-R1, QwQ, and GPT-4.1 outperform other models in both knowledge accuracy and diagnostic performance. Our findings highlight the strengths and limitations of current LLMs in Chinese mental health scenarios and provide clear guidance for selecting and improving models in this sensitive domain.

摘要
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ef67/12365771/1f87be240677/fpsyt-16-1646974-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ef67/12365771/1f87be240677/fpsyt-16-1646974-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/ef67/12365771/1f87be240677/fpsyt-16-1646974-g001.jpg

相似文献

[1]
Evaluation of large language models on mental health: from knowledge test to illness diagnosis.

Front Psychiatry. 2025-8-6

[2]
Using a Diverse Test Suite to Assess Large Language Models on Fast Health Care Interoperability Resources Knowledge: Comparative Analysis.

J Med Internet Res. 2025-8-12

[3]
Performance of Large Language Models in Numerical Versus Semantic Medical Knowledge: Cross-Sectional Benchmarking Study on Evidence-Based Questions and Answers.

J Med Internet Res. 2025-7-14

[4]
Aligning Large Language Models for Enhancing Psychiatric Interviews Through Symptom Delineation and Summarization: Pilot Study.

JMIR Form Res. 2024-10-24

[5]
Implementing Large Language Models in Health Care: Clinician-Focused Review With Interactive Guideline.

J Med Internet Res. 2025-7-11

[6]
A multi-dimensional performance evaluation of large language models in dental implantology: comparison of ChatGPT, DeepSeek, Grok, Gemini and Qwen across diverse clinical scenarios.

BMC Oral Health. 2025-7-28

[7]
Assessing the Accuracy and Reliability of Large Language Models in Psychiatry Using Standardized Multiple-Choice Questions: Cross-Sectional Study.

J Med Internet Res. 2025-5-20

[8]
Large language models (LLMs) in radiology exams for medical students: Performance and consequences.

Rofo. 2024-11-4

[9]
Prescription of Controlled Substances: Benefits and Risks

2025-1

[10]
Applications and Concerns of ChatGPT and Other Conversational Large Language Models in Health Care: Systematic Review.

J Med Internet Res. 2024-11-7

本文引用的文献

[1]
Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data.

Proc ACM Interact Mob Wearable Ubiquitous Technol. 2024-3

[2]
Evaluating Diagnostic Accuracy and Treatment Efficacy in Mental Health: A Comparative Analysis of Large Language Model Tools and Mental Health Professionals.

Eur J Investig Health Psychol Educ. 2025-1-18

[3]
Large Language Models for Mental Health Applications: Systematic Review.

JMIR Ment Health. 2024-10-18

[4]
The Opportunities and Risks of Large Language Models in Mental Health.

JMIR Ment Health. 2024-7-29

[5]
Assessing the Alignment of Large Language Models With Human Values for Mental Health Integration: Cross-Sectional Study Using Schwartz's Theory of Basic Values.

JMIR Ment Health. 2024-4-9

[6]
Old dog, new tricks? Exploring the potential functionalities of ChatGPT in supporting educational methods in social psychiatry.

Int J Soc Psychiatry. 2023-12

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索