Department of Reproductive Health and Research, World Health Organization, Geneva, Switzerland.
Swiss Tropical and Public Health Institute, Basel, Switzerland.
JMIR Mhealth Uhealth. 2019 Sep 27;7(8):e13005. doi: 10.2196/13005.
BACKGROUND: Evidence is lacking on the efficacy of sexual and reproductive health (SRH) communication interventions for youth (aged 15-24 years), especially from low- and middle-income countries. Therefore, the World Health Organization initiated the Adolescent/Youth Reproductive Mobile Access and Delivery Initiative for Love and Life Outcomes (ARMADILLO) program, a free, menu-based, on-demand text message (SMS, short message service) platform providing validated SRH content developed in collaboration with young people. A randomized controlled trial (RCT) assessing the effect of the ARMADILLO intervention on SRH-related outcomes was implemented in Kwale County, Kenya. OBJECTIVE: This paper describes the implementation challenges related to the RCT, observed during enrollment and the intervention period, and their implications for digital health researchers and program implementers. METHODS: This was an open, three-armed RCT. Following completion of a baseline survey, participants were randomized into the ARMADILLO intervention (arm 1), a once-a-week contact SMS text message (arm 2), or usual care (arm 3, no intervention). The intervention period lasted seven weeks, after which participants completed an endline survey. RESULTS: Two study team decisions had significant implications for the success of the trial's enrollment and intervention implementation: a hands-off participant recruitment process and a design flaw in an initial language selection menu. As a result, three weeks after recruitment began, 660 participants had been randomized; however, 107 (53%) participants in arm 1 and 136 (62%) in arm 2 were "stuck" at the language menu. The research team called 231 of these nonengaging participants and successfully reached 136 to learn reasons for nonengagement. Thirty-two phone numbers were found to be either not linked to our participants (a wrong number) or not in their primary possession (a shared phone). Among eligible participants, 30 participants indicated that they had assumed the introductory message was a scam or spam. Twenty-seven participants were confused by some aspect of the system. Eleven were apathetic about engaging. Twenty-four nonengagers experienced some sort of technical issue. All participants eventually started their seven-week study period. CONCLUSIONS: The ARMADILLO study's implementation challenges provide several lessons related to both researching and implementing client-side digital health interventions, including (1) have meticulous phone data collection protocols to reduce wrong numbers, (2) train participants on the digital intervention in efficacy assessments, and (3) recognize that client-side digital health interventions have analog discontinuation challenges. Implementation lessons were (1) determine whether an intervention requires phone ownership or phone access, (2) digital health campaigns need to establish a credible presence in a busy digital space, and (3) interest in a service can be sporadic or fleeting. CLINICAL TRIAL: International Standard Randomized Controlled Trial Number (ISRCTN): 85156148; http://www.isrctn. com/ISRCTN85156148.
背景:目前缺乏针对青年(15-24 岁)的性与生殖健康(SRH)交流干预措施的有效性证据,尤其是来自中低收入国家的证据。因此,世界卫生组织发起了青少年/青年生殖移动获取和交付倡议,以实现爱情和生活成果(ARMADILLO)计划,这是一个免费的、基于菜单的、按需短信(SMS,短消息服务)平台,提供经过验证的 SRH 内容,这些内容是与年轻人合作开发的。在肯尼亚夸莱县实施了一项评估 ARMADILLO 干预措施对 SRH 相关结果影响的随机对照试验(RCT)。
目的:本文描述了在招募和干预期间观察到的与 RCT 相关的实施挑战,以及它们对数字健康研究人员和项目实施者的影响。
方法:这是一项开放的、三臂 RCT。完成基线调查后,参与者被随机分配到 ARMADILLO 干预组(第 1 组)、每周一次的联系短信(第 2 组)或常规护理组(第 3 组,无干预)。干预期持续七周,之后参与者完成了期末调查。
结果:两项研究团队的决策对试验的招募和干预实施的成功产生了重大影响:一是不干预的参与者招募过程,二是最初语言选择菜单的设计缺陷。因此,在招募开始三周后,有 660 名参与者被随机分配;然而,第 1 组中有 107 名(53%)和第 2 组中有 136 名(62%)参与者“卡在”语言菜单上。研究团队致电了其中 231 名未参与的参与者,并成功联系到 136 名参与者,了解其不参与的原因。发现 32 个电话号码要么与我们的参与者无关(错误号码),要么不在他们的主要拥有权范围内(共享电话)。在合格参与者中,有 30 名参与者表示他们认为介绍性信息是骗局或垃圾邮件。27 名参与者对系统的某些方面感到困惑。11 名参与者对参与不感兴趣。24 名不参与的人遇到了某种技术问题。所有参与者最终都开始了他们为期七周的研究期。
结论:ARMADILLO 研究的实施挑战提供了与研究和实施客户端数字健康干预措施相关的几个经验教训,包括:(1)制定详尽的电话数据收集协议,以减少错误号码;(2)在数字干预措施的效果评估中培训参与者;(3)认识到客户端数字健康干预措施具有类似的停药挑战。实施经验教训包括:(1)确定干预措施是否需要电话所有权或电话访问权限;(2)数字健康活动需要在繁忙的数字空间中建立可信的存在;(3)对服务的兴趣可能是零星的或短暂的。
临床试验:国际随机对照试验标准编号(ISRCTN):85156148;http://www.isrctn.com/ISRCTN85156148。