Redmond Nakeva, Harker Laura, Bamps Yvan, Flemming Shauna St Clair, Perryman Jennie P, Thompson Nancy J, Patzer Rachel E, Williams Nancy S DeSousa, Arriola Kimberly R Jacob
Department of Behavioral Sciences and Health Education, Rollins School of Public Health, Emory University, Atlanta, GA, United States.
Georgia Budget and Policy Institute, Atlanta, GA, United States.
J Med Internet Res. 2017 Nov 30;19(11):e396. doi: 10.2196/jmir.8501.
BACKGROUND: The lack of available organs is often considered to be the single greatest problem in transplantation today. Internet use is at an all-time high, creating an opportunity to increase public commitment to organ donation through the broad reach of Web-based behavioral interventions. Implementing Internet interventions, however, presents challenges including preventing fraudulent respondents and ensuring intervention uptake. Although Web-based organ donation interventions have increased in recent years, process evaluation models appropriate for Web-based interventions are lacking. OBJECTIVE: The aim of this study was to describe a refined process evaluation model adapted for Web-based settings and used to assess the implementation of a Web-based intervention aimed to increase organ donation among African Americans. METHODS: We used a randomized pretest-posttest control design to assess the effectiveness of the intervention website that addressed barriers to organ donation through corresponding videos. Eligible participants were African American adult residents of Georgia who were not registered on the state donor registry. Drawing from previously developed process evaluation constructs, we adapted reach (the extent to which individuals were found eligible, and participated in the study), recruitment (online recruitment mechanism), dose received (intervention uptake), and context (how the Web-based setting influenced study implementation) for Internet settings and used the adapted model to assess the implementation of our Web-based intervention. RESULTS: With regard to reach, 1415 individuals completed the eligibility screener; 948 (67.00%) were determined eligible, of whom 918 (96.8%) completed the study. After eliminating duplicate entries (n=17), those who did not initiate the posttest (n=21) and those with an invalid ZIP code (n=108), 772 valid entries remained. Per the Internet protocol (IP) address analysis, only 23 of the 772 valid entries (3.0%) were within Georgia, and only 17 of those were considered unique entries and could be considered for analyses. With respect to recruitment, 517 of the 772 valid entries (67.0%) of participants were recruited from a Web recruiter. Regarding dose received, no videos from the intervention website were watched in their entirety, and the average viewing duration was 17 seconds over the minimum. With respect to context, context analysis provided us with valuable insights into factors in the Internet environment that may have affected study implementation. Although only active for a brief period of time, the Craigslist website advertisement may have contributed the largest volume of fraudulent responses. CONCLUSIONS: We determined fraud and low uptake to be serious threats to this study and further confirmed the importance of conducting a process evaluation to identify such threats. We suggest checking participants' IP addresses before study initiation, selecting software that allows for automatic duplicate protection, and tightening minimum requirements for intervention uptake. Further research is needed to understand how process evaluation models can be used to monitor implementation of Web-based studies.
背景:可用器官的短缺常被认为是当今移植领域最大的单一问题。互联网的使用达到了前所未有的高度,这为通过广泛的基于网络的行为干预来提高公众对器官捐赠的参与度创造了机会。然而,实施互联网干预存在诸多挑战,包括防止欺诈性应答者以及确保干预措施的接受度。尽管近年来基于网络的器官捐赠干预有所增加,但缺乏适用于基于网络干预的过程评估模型。 目的:本研究的目的是描述一种经过改进的、适用于网络环境的过程评估模型,并用于评估一项旨在提高非裔美国人器官捐赠率的基于网络的干预措施的实施情况。 方法:我们采用随机前测-后测对照设计来评估干预网站的有效性,该网站通过相应视频解决器官捐赠的障碍。符合条件的参与者是佐治亚州未在该州捐赠者登记处登记的成年非裔美国居民。借鉴先前开发的过程评估结构,我们针对网络环境对覆盖范围(被认定符合条件并参与研究的个体比例)、招募(在线招募机制)、接受剂量(干预措施的接受度)和背景(基于网络的环境如何影响研究实施)进行了调整,并使用调整后的模型来评估我们基于网络的干预措施的实施情况。 结果:关于覆盖范围,1415人完成了资格筛选;948人(67.00%)被确定符合条件,其中918人(96.8%)完成了研究。在消除重复条目(n = 17)、未启动后测的人员(n = 21)和邮政编码无效的人员(n = 108)后,剩下772个有效条目。根据互联网协议(IP)地址分析,772个有效条目中只有23个(3.0%)位于佐治亚州,其中只有17个被视为唯一条目并可用于分析。关于招募,772个有效参与者条目中有517个(67.0%)是通过网络招募者招募的。关于接受剂量,干预网站的视频没有一个被完整观看,平均观看时长比最短时长多17秒。关于背景,背景分析为我们提供了有关可能影响研究实施的网络环境因素的宝贵见解。尽管Craigslist网站广告只活跃了很短一段时间,但它可能带来了最多的欺诈性回复。 结论:我们确定欺诈和低接受度是本研究的严重威胁,并进一步证实了进行过程评估以识别此类威胁的重要性。我们建议在研究开始前检查参与者的IP地址,选择允许自动防止重复的软件,并收紧干预措施接受度的最低要求。需要进一步研究以了解过程评估模型如何用于监测基于网络的研究的实施情况。
J Natl Med Assoc. 2018-10-13
Clin J Am Soc Nephrol. 2015-2-6
BMC Med Ethics. 2006-12-22
JBI Database System Rev Implement Rep. 2015-1
J Med Internet Res. 2016-6-22
Prog Transplant. 2014-12