Wulff Antje, Montag Sara, Marschollek Michael, Jack Thomas
Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, Hannover, Germany.
Department of Pediatric Cardiology and Intensive Care Medicine, Hannover Medical School, Hannover, Germany.
Methods Inf Med. 2019 Dec;58(S 02):e43-e57. doi: 10.1055/s-0039-1695717. Epub 2019 Sep 9.
The design of computerized systems able to support automated detection of threatening conditions in critically ill patients such as systemic inflammatory response syndrome (SIRS) and sepsis has been fostered recently. The increase of research work in this area is due to both the growing digitalization in health care and the increased appreciation of the importance of early sepsis detection and intervention. To be able to understand the variety of systems and their characteristics as well as performances, a systematic literature review is required. Existing reviews on this topic follow a rather restrictive searching methodology or they are outdated. As much progress has been made during the last 5 years, an updated review is needed to be able to keep track of current developments in this area of research.
To provide an overview about current approaches for the design of clinical decision-support systems (CDSS) in the context of SIRS, sepsis, and septic shock, and to categorize and compare existing approaches.
A systematic literature review was performed in accordance with the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement. Searches for eligible articles were conducted on five electronic bibliographic databases, including PubMed/MEDLINE, IEEE Xplore, Embase, Scopus, and ScienceDirect. Initial results were screened independently by two reviewers based on clearly defined eligibility criteria. A backward as well as an updated search enriched the initial results. Data were extracted from included articles and presented in a standardized way. Articles were classified into predefined categories according to characteristics extracted previously. The classification was performed according to the following categories: clinical setting including patient population and mono- or multicentric study, support type of the system such as prediction or detection, systems characteristics such as knowledge- or data-driven algorithms used, evaluation of methodology, and results including ground truth definition, sensitivity, and specificity. All results were assessed qualitatively by two reviewers.
The search resulted in 2,373 articles out of which 55 results were identified as eligible. Over 80% of the articles describe monocentric studies. More than 50% include adult patients, and only four articles explicitly report the inclusion of pediatric patients. Patient recruitment often is very selective, which can be observed from highly varying inclusion and exclusion criteria. The task of disease detection is covered in 62% of the articles; prediction of upcoming conditions in 33%. Sepsis is covered in 67% of the articles, SIRS as sole entity in only 4%, whereas 27% focus on severe sepsis and/or septic shock. The most common combinations of categories "algorithm used" and "support type" are knowledge-based detection of sepsis and data-driven prediction of sepsis. In evaluations, manual chart review (38%) and diagnosis coding (29%) represent the most frequently used ground truth definitions; most studies present a sample size between 10,001 and 100,000 cases (31%) and performances highly differ with only five articles presenting sensitivities and specificities above 90%; four of them using knowledge-based rather than machine learning algorithms. The presentations of holistic CDSS approaches, including technical implementation details, system interfaces, and data and interoperability aspects enabling the use of CDSS in routine settings are missing in nearly all articles.
The review demonstrated the high variety of research in this context successfully. A clear trend is observable toward the use of data-driven algorithms, and a lack of research could be identified in covering the pediatric population as well as acknowledging SIRS as an independent and threatening condition. The quality as well as the significance of the presented evaluations for assessing the performances of the algorithms in clinical routine settings are often not meeting the current standard of scientific work. Our future interest will be concentrated on these realistic settings by implementing and evaluating SIRS detection approaches as well as considering factors to make the CDSS useable in clinical routine from both technical and medical perspectives.
近年来,能够支持自动检测危重症患者威胁状况(如全身炎症反应综合征(SIRS)和脓毒症)的计算机系统设计得到了推动。该领域研究工作的增加既归因于医疗保健领域日益增长的数字化,也归因于对早期脓毒症检测和干预重要性的认识不断提高。为了能够理解各种系统及其特征以及性能,需要进行系统的文献综述。关于该主题的现有综述采用的搜索方法较为局限,或者已经过时。由于在过去5年中取得了很大进展,因此需要进行更新的综述,以便能够跟踪该研究领域的当前发展。
概述SIRS、脓毒症和感染性休克背景下临床决策支持系统(CDSS)设计的当前方法,并对现有方法进行分类和比较。
根据系统综述和荟萃分析的首选报告项目(PRISMA)声明进行系统的文献综述。在五个电子文献数据库中搜索符合条件的文章,包括PubMed/MEDLINE、IEEE Xplore、Embase、Scopus和ScienceDirect。两名评审员根据明确界定的纳入标准独立筛选初始结果。向后搜索以及更新搜索丰富了初始结果。从纳入的文章中提取数据并以标准化方式呈现。根据先前提取的特征将文章分类到预定义类别中。分类按照以下类别进行:临床环境,包括患者群体以及单中心或多中心研究;系统的支持类型,如预测或检测;系统特征,如使用的基于知识或数据驱动的算法;方法学评估;以及结果,包括金标准定义、敏感性和特异性。所有结果由两名评审员进行定性评估。
搜索结果共得到2373篇文章,其中55篇被确定为符合条件。超过80%的文章描述的是单中心研究。超过50%的文章纳入了成年患者,只有四篇文章明确报告纳入了儿科患者。患者招募往往非常具有选择性,这可以从高度不同的纳入和排除标准中看出。62%的文章涉及疾病检测任务;33%涉及对即将发生情况的预测。67%的文章涉及脓毒症,仅4%的文章将SIRS作为单独实体进行研究,而27%的文章关注严重脓毒症和/或感染性休克。“使用的算法”和“支持类型”类别中最常见的组合是基于知识的脓毒症检测和数据驱动的脓毒症预测。在评估中,人工病历审查(38%)和诊断编码(29%)是最常用的金标准定义;大多数研究的样本量在10001至100000例之间(31%),性能差异很大,只有五篇文章的敏感性和特异性高于90%;其中四篇使用的是基于知识的算法而非机器学习算法。几乎所有文章都缺少对整体CDSS方法的介绍,包括技术实施细节、系统接口以及使CDSS能够在常规环境中使用的数据和互操作性方面。
该综述成功展示了这一背景下研究的高度多样性。可以观察到明显的趋势是使用数据驱动的算法,并且在涵盖儿科人群以及将SIRS视为独立且具有威胁性的状况方面存在研究不足。所呈现的用于评估算法在临床常规环境中性能的评估的质量和重要性往往不符合当前科学工作的标准。我们未来的兴趣将集中在这些现实环境中,通过实施和评估SIRS检测方法,并从技术和医学角度考虑使CDSS能够在临床常规中使用的因素。