Avila Chantal C, Quinn Virginia P, Geiger Ann M, Kerby Tessa J, St Charles Meaghan, Clough-Gorr Kerri M
Kaiser Permanente Southern California, Research & Evaluation, Pasadena, CA, USA.
BMC Res Notes. 2011 Oct 20;4:430. doi: 10.1186/1756-0500-4-430.
Abstractor training is a key element in creating valid and reliable data collection procedures. The choice between in-person vs. remote or simultaneous vs. sequential abstractor training has considerable consequences for time and resource utilization. We conducted a web-based (webinar) abstractor training session to standardize training across six individual Cancer Research Network (CRN) sites for a study of breast cancer treatment effects in older women (BOWII). The goals of this manuscript are to describe the training session, its participants and participants' evaluation of webinar technology for abstraction training.
A webinar was held for all six sites with the primary purpose of simultaneously training staff and ensuring consistent abstraction across sites. The training session involved sequential review of over 600 data elements outlined in the coding manual in conjunction with the display of data entry fields in the study's electronic data collection system. Post-training evaluation was conducted via Survey Monkey©. Inter-rater reliability measures for abstractors within each site were conducted three months after the commencement of data collection.Ten of the 16 people who participated in the training completed the online survey. Almost all (90%) of the 10 trainees had previous medical record abstraction experience and nearly two-thirds reported over 10 years of experience. Half of the respondents had previously participated in a webinar, among which three had participated in a webinar for training purposes. All rated the knowledge and information delivered through the webinar as useful and reported it adequately prepared them for data collection. Moreover, all participants would recommend this platform for multi-site abstraction training. Consistent with participant-reported training effectiveness, results of data collection inter-rater agreement within sites ranged from 89 to 98%, with a weighted average of 95% agreement across sites.
Conducting training via web-based technology was an acceptable and effective approach to standardizing medical record review across multiple sites for this group of experienced abstractors. Given the substantial time and cost savings achieved with the webinar, coupled with participants' positive evaluation of the training session, researchers should consider this instructional method as part of training efforts to ensure high quality data collection in multi-site studies.
摘要提取人员培训是创建有效且可靠的数据收集程序的关键要素。在面对面培训与远程培训之间，以及同步培训与顺序培训之间做出选择，会对时间和资源利用产生重大影响。我们开展了一次基于网络的（网络研讨会形式的）摘要提取人员培训课程，以规范癌症研究网络（CRN）六个独立站点针对老年女性乳腺癌治疗效果研究（BOWII）的培训。本论文的目的是描述该培训课程、其参与者以及参与者对用于摘要提取培训的网络研讨会技术的评价。
为所有六个站点举办了一次网络研讨会，其主要目的是同步培训工作人员并确保各站点的摘要提取工作一致。培训课程包括结合研究电子数据收集系统中数据输入字段的展示，对编码手册中列出的600多个数据元素进行顺序审查。培训后通过Survey Monkey©进行评估。在数据收集开始三个月后，对每个站点内的摘要提取人员进行了评分者间信度测量。参加培训的16人中，有10人完成了在线调查。这10名学员中几乎所有人（90%）都有过病历摘要提取经验，近三分之二的人报告有超过10年的经验。一半的受访者此前参加过网络研讨会，其中三人是为了培训目的而参加的网络研讨会。所有人都认为通过网络研讨会提供的知识和信息很有用，并表示这使其为数据收集做好了充分准备。此外，所有参与者都推荐这个平台用于多站点摘要提取培训。与参与者报告的培训效果一致，各站点内数据收集评分者间一致性结果在89%至98%之间，各站点加权平均一致性为95%。
对于这群经验丰富的摘要提取人员而言，通过基于网络的技术进行培训是在多个站点规范病历审查的一种可接受且有效的方法。鉴于网络研讨会节省了大量时间和成本，再加上参与者对培训课程的积极评价，研究人员应将这种教学方法作为培训工作的一部分，以确保在多站点研究中收集到高质量的数据。
