Hopcroft Lisa Em, Massey Jon, Curtis Helen J, Mackenna Brian, Croker Richard, Brown Andrew D, O'Dwyer Thomas, Macdonald Orla, Evans David, Inglesby Peter, Bacon Sebastian Cj, Goldacre Ben, Walker Alex J
Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, United Kingdom.
Oxford Health NHS Foundation Trust, Oxford, United Kingdom.
JMIR Med Inform. 2023 Apr 19;11:e44237. doi: 10.2196/44237.
Approaches to addressing unwarranted variation in health care service delivery have traditionally relied on the prospective identification of activities and outcomes, based on a hypothesis, with subsequent reporting against defined measures. Practice-level prescribing data in England are made publicly available by the National Health Service (NHS) Business Services Authority for all general practices. There is an opportunity to adopt a more data-driven approach to capture variability and identify outliers by applying hypothesis-free, data-driven algorithms to national data sets.
This study aimed to develop and apply a hypothesis-free algorithm to identify unusual prescribing behavior in primary care data at multiple administrative levels in the NHS in England and to visualize these results using organization-specific interactive dashboards, thereby demonstrating proof of concept for prioritization approaches.
Here we report a new data-driven approach to quantify how "unusual" the prescribing rates of a particular chemical within an organization are as compared to peer organizations, over a period of 6 months (June-December 2021). This is followed by a ranking to identify which chemicals are the most notable outliers in each organization. These outlying chemicals are calculated for all practices, primary care networks, clinical commissioning groups, and sustainability and transformation partnerships in England. Our results are presented via organization-specific interactive dashboards, the iterative development of which has been informed by user feedback.
We developed interactive dashboards for every practice (n=6476) in England, highlighting the unusual prescribing of 2369 chemicals (dashboards are also provided for 42 sustainability and transformation partnerships, 106 clinical commissioning groups, and 1257 primary care networks). User feedback and internal review of case studies demonstrate that our methodology identifies prescribing behavior that sometimes warrants further investigation or is a known issue.
Data-driven approaches have the potential to overcome existing biases with regard to the planning and execution of audits, interventions, and policy making within NHS organizations, potentially revealing new targets for improved health care service delivery. We present our dashboards as a proof of concept for generating candidate lists to aid expert users in their interpretation of prescribing data and prioritize further investigations and qualitative research in terms of potential targets for improved performance.
解决医疗服务提供中不必要差异的方法传统上依赖于基于假设对活动和结果进行前瞻性识别,随后根据既定指标进行报告。英国国家医疗服务体系(NHS)商业服务管理局将英格兰各全科医疗诊所的实践层面处方数据公开。通过将无假设、数据驱动的算法应用于国家数据集,有机会采用更数据驱动的方法来捕捉变异性并识别异常值。
本研究旨在开发并应用一种无假设算法,以识别英格兰NHS多个行政层面基层医疗数据中的异常处方行为,并使用特定组织的交互式仪表板将这些结果可视化,从而证明优先级排序方法的概念验证。
在此,我们报告一种新的数据驱动方法,用于量化在6个月(2021年6月至12月)期间,与同行组织相比,一个组织内特定药物的处方率有多“异常”。随后进行排名,以确定每个组织中哪些药物是最显著的异常值。针对英格兰的所有诊所、基层医疗网络、临床委托小组以及可持续性与转型伙伴关系计算这些异常药物。我们的结果通过特定组织的交互式仪表板呈现,其迭代开发受到了用户反馈的影响。
我们为英格兰的每个诊所(n = 6476)开发了交互式仪表板,突出显示了2369种药物的异常处方情况(还为42个可持续性与转型伙伴关系、106个临床委托小组和1257个基层医疗网络提供了仪表板)。用户反馈和对案例研究的内部审查表明,我们的方法识别出的处方行为有时值得进一步调查,或者是一个已知问题。
数据驱动方法有可能克服NHS组织内部在审计、干预措施和政策制定的规划与执行方面存在的现有偏差,有可能揭示改善医疗服务提供的新目标。我们展示我们的仪表板作为生成候选列表的概念验证,以帮助专家用户解释处方数据,并在提高绩效的潜在目标方面对进一步调查和定性研究进行优先级排序。