Uzuner Ozlem
University at Albany, SUNY, Albany, NY, USA.
J Am Med Inform Assoc. 2009 Jul-Aug;16(4):561-70. doi: 10.1197/jamia.M3115. Epub 2009 Apr 23.
In order to survey, facilitate, and evaluate studies of medical language processing on clinical narratives, i2b2 (Informatics for Integrating Biology to the Bedside) organized its second challenge and workshop. This challenge focused on automatically extracting information on obesity and fifteen of its most common comorbidities from patient discharge summaries. For each patient, obesity and any of the comorbidities could be Present, Absent, or Questionable (i.e., possible) in the patient, or Unmentioned in the discharge summary of the patient. i2b2 provided data for, and invited the development of, automated systems that can classify obesity and its comorbidities into these four classes based on individual discharge summaries. This article refers to obesity and comorbidities as diseases. It refers to the categories Present, Absent, Questionable, and Unmentioned as classes. The task of classifying obesity and its comorbidities is called the Obesity Challenge. The data released by i2b2 was annotated for textual judgments reflecting the explicitly reported information on diseases, and intuitive judgments reflecting medical professionals' reading of the information presented in discharge summaries. There were very few examples of some disease classes in the data. The Obesity Challenge paid particular attention to the performance of systems on these less well-represented classes. A total of 30 teams participated in the Obesity Challenge. Each team was allowed to submit two sets of up to three system runs for evaluation, resulting in a total of 136 submissions. The submissions represented a combination of rule-based and machine learning approaches. Evaluation of system runs shows that the best predictions of textual judgments come from systems that filter the potentially noisy portions of the narratives, project dictionaries of disease names onto the remaining text, apply negation extraction, and process the text through rules. Information on disease-related concepts, such as symptoms and medications, and general medical knowledge help systems infer intuitive judgments on the diseases.
为了调查、促进和评估关于临床叙述的医学语言处理研究,i2b2(整合生物学与床边信息学)组织了第二届挑战赛和研讨会。本次挑战赛的重点是从患者出院小结中自动提取肥胖及其十五种最常见合并症的信息。对于每位患者,肥胖和任何合并症在患者身上可能为存在、不存在、可疑(即有可能),或者在患者的出院小结中未提及。i2b2提供了数据,并邀请开发能够根据个体出院小结将肥胖及其合并症分类为这四类的自动化系统。本文将肥胖及其合并症称为疾病,将存在、不存在、可疑和未提及这几个类别称为类。将肥胖及其合并症进行分类的任务称为肥胖症挑战赛。i2b2发布的数据经过注释,用于反映关于疾病的明确报告信息的文本判断,以及反映医学专业人员对出院小结中呈现信息的解读的直观判断。数据中某些疾病类别的示例非常少。肥胖症挑战赛特别关注系统在这些代表性较差的类别上的表现。共有30个团队参加了肥胖症挑战赛。每个团队最多可提交两组、每组三个系统运行结果进行评估,总共提交了136份结果。这些提交结果代表了基于规则和机器学习方法的结合。系统运行结果的评估表明,文本判断的最佳预测来自那些过滤叙述中潜在噪声部分、将疾病名称词典应用于剩余文本、进行否定提取并通过规则处理文本的系统。关于疾病相关概念(如症状和药物)的信息以及一般医学知识有助于系统推断对疾病的直观判断。