So Ryuhei, Shinohara Kiyomi, Aoki Takuya, Tsujimoto Yasushi, Suganuma Aya M, Furukawa Toshi A
Department of Health Promotion and Human Behavior, Graduate School of Medicine/School of Public Health, Kyoto University, Kyoto, Japan.
Okayama Psychiatric Medical Center, Okayama, Japan.
J Med Internet Res. 2018 Feb 8;20(2):e28. doi: 10.2196/jmir.8561.
Low participation rates are one of the most serious disadvantages of Web-based studies. It is necessary to develop effective strategies to improve participation rates to obtain sufficient data.
The objective of this trial was to investigate the effect of emphasizing the incentive in the subject line of the invitation email and the day of the week of sending the invitation email on the participation rate in a Web-based trial.
We conducted a 2×2 factorial design randomized controlled trial. We contacted 2000 primary care physicians from members of the Japan Primary Care Association in January 2017 and randomly allocated them to 1 of 4 combinations of 2 subject lines (presence or absence of an emphasis on a lottery for an Amazon gift card worth 3000 yen or approximately US $30) and 2 delivery days (sending the invitation email on Tuesday or Friday). The primary outcome was the response rate defined as the number of participants answering the first page of the questionnaire divided by the number of invitation emails delivered. All outcomes were collected between January 17, 2017, and February 8, 2017.
We analyzed data from 1943 out of 2000 participants after excluding those whose email addresses were invalid. The overall response rate was 6.3% (123/1943). There was no significant difference in the response rates between the 2 groups regarding incentive in the subject line: the risk ratio was 1.12 (95% CI 0.80 to 1.58) and the risk difference was 0.7% (95% CI -1.5% to 2.9%). Similarly, there was no significant difference in the response rates between the 2 groups regarding sending the email on Tuesday or Friday: the risk ratio was 0.98 (95% CI 0.70 to 1.38) and the risk difference was -0.1% (95% CI -2.3% to 2.1%).
Neither emphasizing the incentive in the subject line of the invitation email nor varying the day of the week the invitation email was sent led to a meaningful increase in response rates in a Web-based trial with primary care physicians.
University Hospital Medical Information Network Clinical Trials Registry UMIN000025317; https://upload.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000029121 (Archived by WebCite at http://www.webcitation. org/6wOo1jl9t).
低参与率是基于网络的研究最严重的缺点之一。有必要制定有效的策略来提高参与率以获得足够的数据。
本试验的目的是研究在邀请电子邮件主题行中强调激励措施以及发送邀请电子邮件的星期几对基于网络的试验中参与率的影响。
我们进行了一项2×2析因设计随机对照试验。2017年1月,我们联系了日本初级保健协会成员中的2000名初级保健医生,并将他们随机分配到2种主题行(是否强调价值3000日元或约30美元的亚马逊礼品卡抽奖)和2个发送日期(周二或周五发送邀请电子邮件)的4种组合之一。主要结局是应答率,定义为回答问卷第一页的参与者人数除以发送的邀请电子邮件数量。所有结局均在2017年1月17日至2017年2月8日期间收集。
在排除电子邮件地址无效的参与者后,我们分析了2000名参与者中1943人的数据。总体应答率为6.3%(123/1943)。两组在主题行激励方面的应答率无显著差异:风险比为1.12(95%CI 0.80至1.58),风险差为0.7%(95%CI -1.5%至2.9%)。同样,两组在周二或周五发送电子邮件方面的应答率也无显著差异:风险比为0.98(95%CI 0.70至1.38),风险差为-0.1%(95%CI -2.3%至2.1%)。
在邀请电子邮件主题行中强调激励措施以及改变邀请电子邮件的发送星期几,均未导致在针对初级保健医生的基于网络的试验中应答率有显著提高。
大学医院医学信息网络临床试验注册中心UMIN000025317;https://upload.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000029121(由WebCite存档于http://www.webcitation.org/6wOo1jl9t)。