Allen Elizabeth N, Chandler Clare Ir, Mandimika Nyaradzo, Leisegang Cordelia, Barnes Karen
Division of Clinical Pharmacology, Department of Medicine, University of Cape Town, K45, Old Main Building, Groote Schuur Hospital, Observatory, Cape Town, Western Cape, South Africa, 7925.
Cochrane Database Syst Rev. 2018 Jan 16;1(1):MR000039. doi: 10.1002/14651858.MR000039.pub2.
BACKGROUND: Analysis of drug safety in clinical trials involves assessing adverse events (AEs) individually or by aggregate statistical synthesis to provide evidence of likely adverse drug reactions (ADR). While some AEs may be ascertained from physical examinations or tests, there is great reliance on reports from participants to detect subjective symptoms, where he/she is often the only source of information. There is no consensus on how these reports should be elicited, although it is known that questioning methods influence the extent and nature of data detected. This leaves room for measurement error and undermines comparisons between studies and pooled analyses. This review investigated comparisons of methods used in trials to elicit participant-reported AEs. This should contribute to knowledge about the methodological challenges and possible solutions for achieving better, or more consistent, AE ascertainment in trials. OBJECTIVES: To systematically review the research that has compared methods used within clinical drug trials (or methods that would be specific for such trials) to elicit information about AEs defined in the protocol or in the planning for the trial. SEARCH METHODS: Databases (searched to March 2015 unless indicated otherwise) included: Embase; MEDLINE; MEDLINE in Process and Other Non-Indexed Citations; Cochrane Methodology Register (July 2012); Cochrane Central Register of Controlled Trials (February 2015); Cochrane Database of Systematic Reviews; Database of Abstracts of Reviews of Effects (January 2015); Health Technology Assessment database (January 2015); CINAHL; CAB Abstracts; BIOSIS (July 2013); Science Citation Index; Social Science Citation Index; Conference Proceedings Citation Index - Science. The search used thesaurus headings and synonyms for the following concepts: (A): Adverse events AND measurement; (B): Participants AND elicitation (also other synonyms for extraction of information about adverse effects from people); (C): Participants AND checklists (also other synonyms as for B). Pragmatic ways were used to limit the results whilst trying to maintain sensitivity. There were no date or sample size restrictions but only reports published in English were included fully, because of resource constraints as regards translation. SELECTION CRITERIA: Two types of studies were included: drug trials comparing two or more methods within- or between-participants to elicit participant-reported AEs, and research studies performed outside the context of a trial to compare methods which could be used in trials (evidenced by reference to such applicability). Primary outcome data included AEs elicited from participants taking part in any such clinical trial. We included any participant-reported data relevant for an assessment of drug-related harm, using the original authors' terminology (and definition, where available), with comment on whether the data were likely to be treatment-emergent AEs or not. DATA COLLECTION AND ANALYSIS: Titles and abstracts were independently reviewed for eligibility. Full texts of potentially eligible citations were independently reviewed for final eligibility. Relevant data were extracted and subjected to a 100% check. Disagreements were resolved by discussion, involving a third author. The risk of bias was independently assessed by two authors. The Cochrane 'Risk of bias' tool was used for reports comparing outcomes between participants, while for within-participant comparisons, each study was critically evaluated in terms of potential impact of the design and conduct on findings using the framework of selection, performance, detection, attrition, reporting, and other biases. An attempt was made to contact authors to retrieve protocols or specific relevant missing information. Reports were not excluded on the basis of quality unless data for outcomes were impossible to compare (e.g. where denominators differed). A narrative synthesis was conducted because differences in study design and presentation meant that a quantitative meta-analysis was not possible. MAIN RESULTS: The 33 eligible studies largely compared open questions with checklist-type questions or rating scales. Two included participant interviews. Despite different designs, populations and details of questioning methods, the narrative review showed that more specific questioning of participants led to more AEs detected compared to a more general enquiry. A subset of six studies suggested that more severe, bothersome, or otherwise clinically relevant AEs were reported when an initial open enquiry was used, while some less severe, bothersome, or clinically relevant AEs were only reported with a subsequent specific enquiry. However, two studies showed that quite severe or debilitating AEs were only detected by an interview, while other studies did not find a difference in the nature of AEs between elicitation methods. No conclusions could be made regarding the impact of question method on the ability to detect a statistically significant difference between study groups. There was no common statistical rubric, but we were able to represent some effect measures as a risk ratio of the proportion of participants with at least one AE. This showed a lower level of reporting for open questions (O) compared to checklists (CL), with a range for the risk ratios of 0.12 to 0.64. AUTHORS' CONCLUSIONS: This review supports concerns that methods to elicit participant-reported AEs influence the detection of these data. There was a risk for under-detection of AEs in studies using a more general elicitation method compared to those using a comprehensive method. These AEs may be important from a clinical perspective or for patients. This under-detection could compromise ability to pool AE data. However, the impact on the nature of the AE detected by different methods is unclear. The wide variety and low quality of methods to compare elicitation strategies limited this review. Future studies would be improved by using and reporting clear definitions and terminology for AEs (and other important variables), frequency and time period over which they were ascertained, how they were graded, assessed for a relationship to the study drug, coded, and tabulated/reported. While the many potential AE endpoints in a trial may preclude the development of general AE patient-reported outcome measurement instruments, much could also be learnt from how these employ both quantitative and qualitative methods to better understand data elicited. Any chosen questioning method needs to be feasible for use by both staff and participants.
背景:临床试验中的药物安全性分析涉及单独评估不良事件(AE)或通过综合统计合成来提供可能的药物不良反应(ADR)的证据。虽然一些AE可以通过体格检查或测试确定,但很大程度上依赖于参与者的报告来检测主观症状,而参与者往往是唯一的信息来源。尽管已知提问方法会影响检测到的数据的范围和性质,但对于如何引出这些报告尚无共识。这就为测量误差留下了空间,并削弱了研究之间的比较和汇总分析。本综述调查了试验中用于引出参与者报告的AE的方法的比较。这有助于了解在试验中实现更好或更一致的AE确定的方法学挑战和可能的解决方案。 目的:系统评价比较临床药物试验中使用的方法(或此类试验特有的方法)以引出方案或试验计划中定义的AE信息的研究。 检索方法:数据库(除非另有说明,检索至2015年3月)包括:Embase;MEDLINE;MEDLINE在研及其他未索引引文;Cochrane方法学注册库(2012年7月);Cochrane对照试验中央注册库(2015年2月);Cochrane系统评价数据库;效果评价摘要数据库(2015年1月);卫生技术评估数据库(2015年1月);CINAHL;CAB文摘;BIOSIS(2013年7月);科学引文索引;社会科学引文索引;会议论文引文索引 - 科学。检索使用了以下概念的主题词和同义词:(A):不良事件与测量;(B):参与者与引出(也包括从人那里提取不良反应信息的其他同义词);(C):参与者与检查表(也包括与B相同的其他同义词)。采用实用的方法来限制结果,同时努力保持敏感性。没有日期或样本量限制,但由于翻译资源限制,仅完全纳入英文发表的报告。 选择标准:纳入两种类型的研究:在参与者内或参与者间比较两种或更多方法以引出参与者报告的AE的药物试验,以及在试验背景之外进行的比较可用于试验的方法的研究(通过提及此类适用性来证明)。主要结局数据包括从参与任何此类临床试验的参与者中引出的AE。我们纳入了任何与评估药物相关伤害相关的参与者报告的数据,使用原始作者的术语(以及可用的定义),并评论这些数据是否可能是治疗中出现的AE。 数据收集与分析:独立审查标题和摘要以确定其是否符合纳入标准。对潜在符合条件的引文的全文进行独立审查以确定最终是否符合纳入标准。提取相关数据并进行100%核对。通过讨论解决分歧,涉及第三位作者。由两位作者独立评估偏倚风险。对于比较参与者间结局的报告,使用Cochrane“偏倚风险”工具,而对于参与者内比较,使用选择、实施、检测、失访、报告和其他偏倚的框架,根据设计和实施对结果的潜在影响对每项研究进行严格评估。试图联系作者以检索方案或特定相关的缺失信息。除非结局数据无法比较(例如分母不同),否则不根据质量排除报告。进行叙述性综合分析,因为研究设计和呈现方式的差异意味着无法进行定量荟萃分析。 主要结果:33项符合条件的研究主要比较了开放式问题与检查表式问题或评分量表。两项研究包括参与者访谈。尽管设计、人群和提问方法的细节不同,但叙述性综述表明,与更一般的询问相比,对参与者进行更具体的提问会导致检测到更多的AE。六项研究的一个子集表明,当使用初始开放式询问时,会报告更严重、更麻烦或其他临床上相关的AE,而一些不太严重、不太麻烦或临床上相关的AE仅在随后的具体询问中报告。然而,两项研究表明,相当严重或使人衰弱的AE仅通过访谈检测到,而其他研究未发现引出方法之间AE性质的差异。关于提问方法对检测研究组之间统计学显著差异的能力的影响,无法得出结论。没有通用的统计准则,但我们能够将一些效应量表示为至少有一个AE的参与者比例的风险比。这表明与检查表(CL)相比,开放式问题(O)的报告水平较低,风险比范围为0.12至0.64。 作者结论:本综述支持这样的担忧,即引出参与者报告的AE的方法会影响这些数据的检测。与使用综合方法的研究相比,使用更一般引出方法的研究存在AE检测不足的风险。从临床角度或对患者而言,这些AE可能很重要。这种检测不足可能会损害汇总AE数据的能力。然而,不同方法对检测到的AE性质的影响尚不清楚。比较引出策略的方法种类繁多且质量较低,限制了本综述。未来的研究可以通过使用并报告AE(和其他重要变量)的清晰定义和术语、确定它们的频率和时间段、如何对它们进行分级、评估与研究药物的关系、编码以及列表/报告来改进。虽然试验中许多潜在的AE终点可能会妨碍通用的AE患者报告结局测量工具的开发,但从这些工具如何采用定量和定性方法来更好地理解引出的数据中也可以学到很多东西。任何选择的提问方法都需要工作人员和参与者都可行。
Cochrane Database Syst Rev. 2018-1-16
Cochrane Database Syst Rev. 2022-5-20
Health Technol Assess. 2001
Cochrane Database Syst Rev. 2022-6-9
Cochrane Database Syst Rev. 2005-7-20
Cochrane Database Syst Rev. 2018-2-6
Cochrane Database Syst Rev. 2022-7-8
Cochrane Database Syst Rev. 2025-1-29
Cochrane Database Syst Rev. 2018-2-9
Neuropsychopharmacology. 2024-7
Basic Clin Pharmacol Toxicol. 2022-12
Cochrane Database Syst Rev. 2022-4-4
CNS Neurol Disord Drug Targets. 2015
J Am Acad Child Adolesc Psychiatry. 2015-3
J Evid Based Med. 2012-8