Gao Yanjun, Dligach Dmitriy, Miller Timothy, Churpek Matthew M, Afshar Majid
University of Wisconsin.
Loyola University Chicago.
Proc Conf Assoc Comput Linguist Meet. 2023 Jul;2023:461-467. doi: 10.18653/v1/2023.bionlp-1.43.
The BioNLP Workshop 2023 initiated the launch of a shared task on Problem List Summarization (ProbSum) in January 2023. The aim of this shared task is to attract future research efforts in building NLP models for real-world diagnostic decision support applications, where a system generating relevant and accurate diagnoses will augment the healthcare providers' decision-making process and improve the quality of care for patients. The goal for participants is to develop models that generated a list of diagnoses and problems using input from the daily care notes collected from the hospitalization of critically ill patients. Eight teams submitted their final systems to the shared task leaderboard. In this paper, we describe the tasks, datasets, evaluation metrics, and baseline systems. Additionally, the techniques and results of the evaluation of the different approaches tried by the participating teams are summarized.
生物自然语言处理研讨会2023于2023年1月启动了问题列表总结(ProbSum)共享任务。此共享任务的目的是吸引未来在构建用于现实世界诊断决策支持应用的自然语言处理模型方面的研究工作,在这类应用中,一个生成相关且准确诊断的系统将增强医疗保健提供者的决策过程并提高患者护理质量。参与者的目标是开发模型,该模型使用从重症患者住院期间收集的日常护理记录中的输入来生成诊断和问题列表。八个团队将其最终系统提交到了共享任务排行榜。在本文中,我们描述了任务、数据集、评估指标和基线系统。此外,还总结了参与团队尝试的不同方法的评估技术和结果。