Li Ying, Ryan Patrick B, Wei Ying, Friedman Carol
Department of Biomedical Informatics, Columbia University Medical Center, 622 W. 168th Street, Presbyterian Building 20th Floor, New York, NY, 10032, USA.
Janssen Research and Development, 1125 Trenton Harbourton Rd, Titusville, NJ, 08560, USA.
Drug Saf. 2015 Oct;38(10):895-908. doi: 10.1007/s40264-015-0314-8.
Observational healthcare data contain information useful for hastening detection of adverse drug reactions (ADRs) that may be missed by using data in spontaneous reporting systems (SRSs) alone. There are only several papers describing methods that integrate evidence from healthcare databases and SRSs. We propose a methodology that combines ADR signals from these two sources.
The aim of this study was to investigate whether the proposed method would result in more accurate ADR detection than methods using SRSs or healthcare data alone.
We applied the method to four clinically serious ADRs, and evaluated it using three experiments that involve combining an SRS with a single facility small-scale electronic health record (EHR), a larger scale network-based EHR, and a much larger scale healthcare claims database. The evaluation used a reference standard comprising 165 positive and 234 negative drug-ADR pairs.
Area under the receiver operator characteristics curve (AUC) was computed to measure performance.
There was no improvement in the AUC when the SRS and small-scale HER were combined. The AUC of the combined SRS and large-scale EHR was 0.82 whereas it was 0.76 for each of the individual systems. Similarly, the AUC of the combined SRS and claims system was 0.82 whereas it was 0.76 and 0.78, respectively, for the individual systems.
The proposed method resulted in a significant improvement in the accuracy of ADR detection when the resources used for combining had sufficient amounts of data, demonstrating that the method could integrate evidence from multiple sources and serve as a tool in actual pharmacovigilance practice.
观察性医疗保健数据包含有助于加速发现不良药物反应(ADR)的信息,而仅使用自发报告系统(SRS)中的数据可能会遗漏这些信息。仅有几篇论文描述了整合来自医疗保健数据库和SRS证据的方法。我们提出了一种结合这两种来源ADR信号的方法。
本研究的目的是调查所提出的方法是否比单独使用SRS或医疗保健数据的方法能更准确地检测ADR。
我们将该方法应用于四种临床严重的ADR,并通过三个实验对其进行评估,这三个实验分别涉及将SRS与单个机构的小规模电子健康记录(EHR)、更大规模的基于网络的EHR以及规模大得多的医疗保健理赔数据库相结合。评估使用了包含165对阳性和234对阴性药物 - ADR对的参考标准。
计算受试者操作特征曲线下面积(AUC)以衡量性能。
当SRS与小规模HER结合时,AUC没有改善。SRS与大规模EHR结合后的AUC为0.82,而每个单独系统的AUC为0.76。同样,SRS与理赔系统结合后的AUC为0.82,而单独系统的AUC分别为0.76和0.78。
当用于合并的资源有足够的数据量时,所提出的方法在ADR检测准确性方面有显著提高,表明该方法可以整合来自多个来源的证据,并可作为实际药物警戒实践中的一种工具。