Zemore Sarah E, Delk Joanne, Mericle Amy A, Martinez Priscilla, Timko Christine
Alcohol Research Group, Emeryville, California, USA.
Stanford University School of Medicine, Stanford, California, USA.
Alcohol Clin Exp Res (Hoboken). 2024 Sep;48(9):1795-1806. doi: 10.1111/acer.15413. Epub 2024 Aug 6.
Although studies are increasingly adopting online protocols, few such studies in the addiction field have comprehensively described their data review procedures and successes in detecting low-quality/fraudulent data. The current study describes data collection protocols and outcomes of a large, longitudinal study (the PAL Study 2021) that implemented online design elements to study individuals seeking peer support for an alcohol use disorder.
In 2021, the PAL Study collaborated with mutual-help group (MHG) partners and recovery-related organizations to recruit individuals attending a 12-step group, Women for Sobriety (WFS), LifeRing Secular Recovery, and/or SMART Recovery for an alcohol problem in-person and/or online in the prior 30 days. Participation was solicited both online and in-person. Individuals accessed baseline surveys via an open web link; follow-ups occurred at 6 and 12 months. Analyses included calculating the proportion of surveys eliminated in data quality review; comparing MHG subsamples to internal survey (benchmark) data for Alcoholics Anonymous (AA), WFS, LifeRing, and SMART; and examining response rates and attrition.
Although 93% of respondents who opened the baseline survey completed it, 87% of baseline surveys were eliminated in data quality review (final N = 531). Nonetheless, cleaned MHG subsamples were generally similar to benchmark samples on gender, age, race/ethnicity, and education. Follow-up rates for the cleaned sample were 88% (6 months) and 85% (12 months). Analyses revealed some differences in attrition by gender, primary MHG, and lifetime drug problems, but there was no evidence of greater attrition among those in earlier/less stable recovery.
Study methods appear to have produced a valid, largely representative sample of the hard-to-reach target population that was successfully followed across 12 months. However, given the high survey elimination rate and need for extensive data review, we recommend that researchers avoid open-link designs and include comprehensive data review when incorporating online design elements.
尽管越来越多的研究采用在线方案，但成瘾领域中很少有此类研究全面描述其数据审查程序以及在检测低质量/欺诈性数据方面的成效。本研究描述了一项大型纵向研究（2021年PAL研究）的数据收集方案和结果，该研究采用在线设计元素来研究寻求酒精使用障碍同伴支持的个体。
2021年，PAL研究与互助小组（MHG）合作伙伴及康复相关组织合作，招募在过去30天内亲自或在线参加过12步小组、戒酒女性组织（WFS）、无教派戒酒康复组织或SMART戒酒康复组织以解决酒精问题的个体。通过线上和线下两种方式进行招募。个体通过开放的网页链接访问基线调查；随访在6个月和12个月时进行。分析内容包括计算在数据质量审查中被排除的调查比例；将MHG子样本与戒酒互助会（AA）、WFS、无教派戒酒康复组织和SMART的内部调查（基准）数据进行比较；以及检查应答率和失访情况。
尽管93%打开基线调查的受访者完成了调查，但在数据质量审查中87%的基线调查被排除（最终样本量N = 531）。尽管如此，经过清理的MHG子样本在性别、年龄、种族/民族和教育程度方面通常与基准样本相似。清理后样本的随访率分别为88%（6个月）和85%（12个月）。分析显示，在失访情况上存在性别、主要MHG和终身药物问题方面的一些差异，但没有证据表明处于早期/恢复不太稳定阶段的个体失访情况更严重。
研究方法似乎产生了一个有效且在很大程度上具有代表性的难以接触到的目标人群样本，并在12个月内成功进行了跟踪。然而，鉴于调查排除率高以及需要进行广泛的数据审查，我们建议研究人员避免使用开放链接设计，并在纳入在线设计元素时进行全面的数据审查。
