Effect of Web-Based Versus Paper-Based Questionnaires and Follow-Up Strategies on Participation Rates of Dutch Childhood Cancer Survivors: A Randomized Controlled Trial.

BACKGROUND

Questionnaires are widely used in survey research, especially in cohort studies. However, participation in questionnaire studies has been declining over the past decades. Because high participation rates are needed to limit the risk of selection bias and produce valid results, it is important to investigate invitation strategies which may improve participation.

OBJECTIVES

The purpose of this study is to investigate the effect of Web-based versus paper-based questionnaires on participation rates in a questionnaire survey on late effects among childhood cancer survivors (CCSs).

METHODS

A total of 750 CCSs were randomized across 3 study arms. The initial invitation in study arms 1 and 2 consisted of a Web-based questionnaire only, whereas in study arm 3 this invitation was complemented with a paper-based version of the questionnaire. The first postal reminder, sent to the nonresponding CCSs in all 3 study arms, consisted of either a reminder letter only (study arms 1 and 3) or a reminder letter complemented with a paper-based questionnaire (study arm 2). The second postal reminder was restricted to CCSs in study arms 1 and 2, with only those in study arm 1 also receiving a paper-based questionnaire. CCSs in study arm 3 received a second reminder by telephone instead of by mail. In contrast to CCSs in study arm 3, CCSs in study arms 1 and 2 received a third reminder, this time by telephone. Results: Overall, 58.1% (436/750) of the CCSs participated in the survey. Participation rates were equal in all 3 study arms with 57.4% (143/249) in arm 1, 60.6% (152/251) in arm 2, and 56.4% (141/250) in arm 3 (P=.09). Participation rates of CCSs who received an initial invitation for the Web-based questionnaire only and CCSs who received an invitation to complete either a paper-based or Web-based questionnaire did not differ (P=.55). After the first postal reminder, participation rates of CCSs invited for the Web-based questionnaire only also did not differ compared with CCSs invited for both the Web-based and paper-based questionnaires (P=.48). In general, CCSs preferred the paper-based over the Web-based questionnaire, and those completing the paper-based questionnaire were more often unemployed (P=.004) and lower educated (P<.001).

CONCLUSION

Invitation strategies offering a Web-based questionnaire without a paper-based alternative at first invitation can be used without compromising participation rates of CCS. Offering the choice between paper- and Web-based questionnaires seems to result in the highest accrual participation rate. Future research should look into the quality of the data delivered by both questionnaires filled in by respondents themselves.

TRIAL REGISTRATION

International Standard Randomized Controlled Trial Number (ISRCTN): 84711754; http://www.controlled-trials.com/ISRCTN84711754 (Archived by WebCite at http://www.webcitation.org/6c9ZB8paX).