• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

2023年电子健康记录病程记录中患者当前诊断和问题总结的问题列表总结(ProbSum)共享任务概述

Overview of the Problem List Summarization (ProbSum) 2023 Shared Task on Summarizing Patients' Active Diagnoses and Problems from Electronic Health Record Progress Notes.

作者信息

Gao Yanjun, Dligach Dmitriy, Miller Timothy, Churpek Matthew M, Afshar Majid

机构信息

University of Wisconsin.

Loyola University Chicago.

出版信息

Proc Conf Assoc Comput Linguist Meet. 2023 Jul;2023:461-467. doi: 10.18653/v1/2023.bionlp-1.43.

DOI:10.18653/v1/2023.bionlp-1.43
PMID:37583489
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10426335/
Abstract

The BioNLP Workshop 2023 initiated the launch of a shared task on Problem List Summarization (ProbSum) in January 2023. The aim of this shared task is to attract future research efforts in building NLP models for real-world diagnostic decision support applications, where a system generating relevant and accurate diagnoses will augment the healthcare providers' decision-making process and improve the quality of care for patients. The goal for participants is to develop models that generated a list of diagnoses and problems using input from the daily care notes collected from the hospitalization of critically ill patients. Eight teams submitted their final systems to the shared task leaderboard. In this paper, we describe the tasks, datasets, evaluation metrics, and baseline systems. Additionally, the techniques and results of the evaluation of the different approaches tried by the participating teams are summarized.

摘要

生物自然语言处理研讨会2023于2023年1月启动了问题列表总结(ProbSum)共享任务。此共享任务的目的是吸引未来在构建用于现实世界诊断决策支持应用的自然语言处理模型方面的研究工作,在这类应用中,一个生成相关且准确诊断的系统将增强医疗保健提供者的决策过程并提高患者护理质量。参与者的目标是开发模型,该模型使用从重症患者住院期间收集的日常护理记录中的输入来生成诊断和问题列表。八个团队将其最终系统提交到了共享任务排行榜。在本文中,我们描述了任务、数据集、评估指标和基线系统。此外,还总结了参与团队尝试的不同方法的评估技术和结果。

相似文献

1
Overview of the Problem List Summarization (ProbSum) 2023 Shared Task on Summarizing Patients' Active Diagnoses and Problems from Electronic Health Record Progress Notes.2023年电子健康记录病程记录中患者当前诊断和问题总结的问题列表总结(ProbSum)共享任务概述
Proc Conf Assoc Comput Linguist Meet. 2023 Jul;2023:461-467. doi: 10.18653/v1/2023.bionlp-1.43.
2
Summarizing Patients' Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Models.使用预训练的序列到序列模型从医院病程记录中总结患者问题
Proc Int Conf Comput Ling. 2022 Oct;2022:2979-2991.
3
Progress Note Understanding - Assessment and Plan Reasoning: Overview of the 2022 N2C2 Track 3 shared task.进展记录理解-评估和计划推理:2022 年 N2C2 第 3 轨道共享任务概述。
J Biomed Inform. 2023 Jun;142:104346. doi: 10.1016/j.jbi.2023.104346. Epub 2023 Apr 13.
4
The 2019 n2c2/OHNLP Track on Clinical Semantic Textual Similarity: Overview.2019年n2c2/OHNLP临床语义文本相似性赛道:概述
JMIR Med Inform. 2020 Nov 27;8(11):e23375. doi: 10.2196/23375.
5
A qualitative systematic review of internal and external influences on shared decision-making in all health care settings.对所有医疗环境中共同决策的内部和外部影响进行的定性系统评价。
JBI Libr Syst Rev. 2012;10(58):4633-4646. doi: 10.11124/jbisrir-2012-432.
6
Building a Shared, Scalable, and Sustainable Source for the Problem-Oriented Medical Record: Developmental Study.构建面向问题的医疗记录的共享、可扩展且可持续的资源:发展性研究。
JMIR Med Inform. 2021 Oct 13;9(10):e29174. doi: 10.2196/29174.
7
Family History Extraction From Synthetic Clinical Narratives Using Natural Language Processing: Overview and Evaluation of a Challenge Data Set and Solutions for the 2019 National NLP Clinical Challenges (n2c2)/Open Health Natural Language Processing (OHNLP) Competition.利用自然语言处理从合成临床叙述中提取家族病史:2019年国家自然语言处理临床挑战(n2c2)/开放健康自然语言处理(OHNLP)竞赛的挑战数据集概述与评估及解决方案
JMIR Med Inform. 2021 Jan 27;9(1):e24008. doi: 10.2196/24008.
8
A scoping review of publicly available language tasks in clinical natural language processing.临床自然语言处理中公开可用语言任务的范围综述
J Am Med Inform Assoc. 2022 Sep 12;29(10):1797-1806. doi: 10.1093/jamia/ocac127.
9
Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas.在流行地区,服用抗叶酸抗疟药物的人群中,叶酸补充剂与疟疾易感性和严重程度的关系。
Cochrane Database Syst Rev. 2022 Feb 1;2(2022):CD014217. doi: 10.1002/14651858.CD014217.
10
Overview of the BioCreative III Workshop.第三届生物创意研讨会概述。
BMC Bioinformatics. 2011 Oct 3;12 Suppl 8(Suppl 8):S1. doi: 10.1186/1471-2105-12-S8-S1.

引用本文的文献

1
Development of a Human Evaluation Framework and Correlation with Automated Metrics for Natural Language Generation of Medical Diagnoses.用于医学诊断自然语言生成的人工评估框架的开发及其与自动指标的相关性
AMIA Annu Symp Proc. 2025 May 22;2024:309-318. eCollection 2024.
2
Automating Evaluation of AI Text Generation in Healthcare with a Large Language Model (LLM)-as-a-Judge.使用大语言模型(LLM)作为评判器对医疗保健领域的人工智能文本生成进行自动化评估。
medRxiv. 2025 May 6:2025.04.22.25326219. doi: 10.1101/2025.04.22.25326219.
3
Leveraging Medical Knowledge Graphs Into Large Language Models for Diagnosis Prediction: Design and Application Study.

本文引用的文献

1
Summarizing Patients' Problems from Hospital Progress Notes Using Pre-trained Sequence-to-Sequence Models.使用预训练的序列到序列模型从医院病程记录中总结患者问题
Proc Int Conf Comput Ling. 2022 Oct;2022:2979-2991.
2
Hierarchical Annotation for Building A Suite of Clinical Natural Language Processing Tasks: Progress Note Understanding.用于构建临床自然语言处理任务套件的分层标注:病程记录理解
LREC Int Conf Lang Resour Eval. 2022 Jun;2022:5484-5493.
3
A scoping review of publicly available language tasks in clinical natural language processing.
将医学知识图谱融入大语言模型进行诊断预测:设计与应用研究
JMIR AI. 2025 Feb 24;4:e58670. doi: 10.2196/58670.
4
Exploring the Efficacy of Large Language Models in Summarizing Mental Health Counseling Sessions: Benchmark Study.探讨大型语言模型在总结心理健康咨询会话中的功效:基准研究。
JMIR Ment Health. 2024 Jul 23;11:e57306. doi: 10.2196/57306.
5
Pre-test Prediction of Non-ischemic Cardiomyopathies using Time-Series EHR Data.使用时间序列电子健康记录数据对非缺血性心肌病进行预测试预测
AMIA Jt Summits Transl Sci Proc. 2024 May 31;2024:239-248. eCollection 2024.
6
Development of a Human Evaluation Framework and Correlation with Automated Metrics for Natural Language Generation of Medical Diagnoses.用于医学诊断自然语言生成的人类评估框架的开发及其与自动化指标的相关性
medRxiv. 2024 Apr 9:2024.03.20.24304620. doi: 10.1101/2024.03.20.24304620.
7
Clinical Text Summarization: Adapting Large Language Models Can Outperform Human Experts.临床文本摘要:适配大语言模型可超越人类专家。
Res Sq. 2023 Oct 30:rs.3.rs-3483777. doi: 10.21203/rs.3.rs-3483777/v1.
临床自然语言处理中公开可用语言任务的范围综述
J Am Med Inform Assoc. 2022 Sep 12;29(10):1797-1806. doi: 10.1093/jamia/ocac127.
4
"Note Bloat" impacts deep learning-based NLP models for clinical prediction tasks.“注释膨胀”影响基于深度学习的临床预测任务的自然语言处理模型。
J Biomed Inform. 2022 Sep;133:104149. doi: 10.1016/j.jbi.2022.104149. Epub 2022 Jul 22.
5
Tasks as needs: reframing the paradigm of clinical natural language processing research for real-world decision support.任务需求:为现实世界的决策支持重新构建临床自然语言处理研究的范例。
J Am Med Inform Assoc. 2022 Sep 12;29(10):1810-1817. doi: 10.1093/jamia/ocac121.
6
Generating Accurate Electronic Health Assessment from Medical Graph.从医学图谱生成准确的电子健康评估。
Proc Conf Empir Methods Nat Lang Process. 2020 Nov;2020:3764-3773. doi: 10.18653/v1/2020.findings-emnlp.336.
7
Information overload and unsustainable workloads in the era of electronic health records.电子健康记录时代的信息过载与不可持续的工作量。
Lancet Respir Med. 2020 Mar;8(3):243-244. doi: 10.1016/S2213-2600(20)30010-2. Epub 2020 Jan 13.
8
Challenges and Opportunities to Improve the Clinician Experience Reviewing Electronic Progress Notes.改善临床医生查看电子病历体验的挑战与机遇。
Appl Clin Inform. 2019 May;10(3):446-453. doi: 10.1055/s-0039-1692164. Epub 2019 Jun 19.
9
MIMIC-III, a freely accessible critical care database.MIMIC-III,一个免费获取的重症监护数据库。
Sci Data. 2016 May 24;3:160035. doi: 10.1038/sdata.2016.35.
10
BioCreative V CDR task corpus: a resource for chemical disease relation extraction.生物创意V化学疾病关系提取任务语料库:化学疾病关系提取的资源。
Database (Oxford). 2016 May 9;2016. doi: 10.1093/database/baw068. Print 2016.