Sydney School of Public Health, University of Sydney, Camperdown, New South Wales, Australia.
Wesfarmers Centre of Vaccines and Infectious Diseases, Telethon Kids Institute, University of Western Australia, Nedlands, Western Australia, Australia.
PLoS Comput Biol. 2023 Mar 13;19(3):e1010967. doi: 10.1371/journal.pcbi.1010967. eCollection 2023 Mar.
Pneumonia remains a leading cause of hospitalization and death among young children worldwide, and the diagnostic challenge of differentiating bacterial from non-bacterial pneumonia is the main driver of antibiotic use for treating pneumonia in children. Causal Bayesian networks (BNs) serve as powerful tools for this problem as they provide clear maps of probabilistic relationships between variables and produce results in an explainable way by incorporating both domain expert knowledge and numerical data.
We used domain expert knowledge and data in combination and iteratively, to construct, parameterise and validate a causal BN to predict causative pathogens for childhood pneumonia. Expert knowledge elicitation occurred through a series of group workshops, surveys and one-on-one meetings involving 6-8 experts from diverse domain areas. The model performance was evaluated based on both quantitative metrics and qualitative expert validation. Sensitivity analyses were conducted to investigate how the target output is influenced by varying key assumptions of a particularly high degree of uncertainty around data or domain expert knowledge.
Designed to apply to a cohort of children with X-ray confirmed pneumonia who presented to a tertiary paediatric hospital in Australia, the resulting BN offers explainable and quantitative predictions on a range of variables of interest, including the diagnosis of bacterial pneumonia, detection of respiratory pathogens in the nasopharynx, and the clinical phenotype of a pneumonia episode. Satisfactory numeric performance has been achieved including an area under the receiver operating characteristic curve of 0.8 in predicting clinically-confirmed bacterial pneumonia with sensitivity 88% and specificity 66% given certain input scenarios (i.e., information that is available and entered into the model) and trade-off preferences (i.e., relative weightings of the consequences of false positive versus false negative predictions). We specifically highlight that a desirable model output threshold for practical use is very dependent upon different input scenarios and trade-off preferences. Three commonly encountered scenarios were presented to demonstrate the potential usefulness of the BN outputs in various clinical pictures.
To our knowledge, this is the first causal model developed to help determine the causative pathogen for paediatric pneumonia. We have shown how the method works and how it would help decision making on the use of antibiotics, providing insight into how computational model predictions may be translated to actionable decisions in practice. We discussed key next steps including external validation, adaptation and implementation. Our model framework and the methodological approach can be adapted beyond our context to broad respiratory infections and geographical and healthcare settings.
肺炎仍然是全球导致儿童住院和死亡的主要原因,区分细菌性和非细菌性肺炎的诊断挑战是导致儿童肺炎抗生素治疗的主要驱动因素。因果贝叶斯网络(BNs)作为一种强大的工具,可提供变量之间概率关系的清晰图谱,并通过结合领域专家知识和数值数据以可解释的方式生成结果。
我们使用领域专家知识和数据相结合,并通过迭代,构建、参数化和验证因果 BN 来预测儿童肺炎的病原体。通过一系列小组研讨会、调查和一对一会议,邀请来自不同领域的 6-8 位专家来进行专家知识的启发式挖掘。通过定量指标和定性专家验证来评估模型性能。进行敏感性分析以研究在数据或领域专家知识存在高度不确定性的关键假设发生变化时,目标输出如何受到影响。
该 BN 旨在适用于在澳大利亚一家三级儿科医院就诊的经 X 光确诊为肺炎的患儿队列,该 BN 提供了一系列感兴趣变量的可解释和定量预测,包括细菌性肺炎的诊断、鼻咽部呼吸道病原体的检测以及肺炎发作的临床表型。已经取得了令人满意的数值性能,包括在预测临床确诊的细菌性肺炎时,接收者操作特征曲线下面积为 0.8,在某些输入场景(即可获得并输入模型的信息)和权衡偏好(即假阳性与假阴性预测后果的相对权重)下,灵敏度为 88%,特异性为 66%。我们特别强调,实用模型输出阈值非常依赖于不同的输入场景和权衡偏好。我们展示了三个常见的场景,以展示 BN 输出在各种临床情况下的潜在用途。
据我们所知,这是第一个旨在帮助确定儿童肺炎病原体的因果模型。我们展示了该方法的工作原理,以及它如何帮助决策抗生素的使用,深入了解计算模型预测如何在实践中转化为可操作的决策。我们讨论了关键的下一步,包括外部验证、适应和实施。我们的模型框架和方法可以在我们的背景之外扩展到广泛的呼吸道感染和地理及医疗保健环境。