Alcaraz-Ibáñez Manuel, Paterna Adrian, Sicilia Álvaro, Griffiths Mark D
1 Health Research Centre and Department of Education, University of Almería, Spain.
2 Psychology Department, Nottingham Trent University, UK.
J Behav Addict. 2022 Apr 28;11(2):326-47. doi: 10.1556/2006.2022.00014.
Problematic exercise (PE) has mainly been assessed with self-report instruments. However, summarized evidence on the reliability of the scores derived from such instruments has yet to be provided. The present study reports a reliability generalization meta-analysis of six well-known self-report measures of PE (Commitment to Exercise Scale, Compulsive Exercise Test, Exercise Addiction Inventory, Exercise Dependence Questionnaire, Exercise Dependence Scale, and Obligatory Exercise Questionnaire).
Pooled effect sizes were computed using a random-effect model employing a restricted maximum likelihood estimation method. Univariable and multivariable meta-regressions analyses were employed for testing moderator variables.
Data retrieved from 255 studies (741 independent samples, N = 254,174) identified three main groups of findings: (i) pooled alpha values that, ranging from 0.768 to 0.930 for global scores and from 0.615 to 0.907 for subscale scores, were found to be sensitive to sociodemographic and methodological characteristics; (ii) reliability induction rates of 47.58%; and (iii) the virtually non-existent testing of the assumptions required for the proper applicability of alpha. Data unavailability prevented the provision of summarized reliability estimates in terms of temporal stability.
These findings highlight the need to improve reliability reporting of the scores of self-reported instruments of PE in primary studies. This implies providing both prior justification for the appropriateness of the index employed and reliability data for all the subpopulation of interest. The values presented could be used as a reference both for comparisons with those obtained in future primary studies and for correcting measurement-related artefacts in quantitative meta-analytic research concerning PE.
问题性运动（PE）主要通过自我报告工具进行评估。然而，尚未提供关于此类工具所得分数可靠性的汇总证据。本研究报告了对六种著名的PE自我报告测量方法（运动投入量表、强迫性运动测试、运动成瘾量表、运动依赖问卷、运动依赖量表和强制性运动问卷）的可靠性概括性元分析。
使用采用限制最大似然估计方法的随机效应模型计算合并效应量。采用单变量和多变量元回归分析来检验调节变量。
从255项研究（741个独立样本，N = 254,174）中检索到的数据确定了三组主要结果：（i）合并的α值，全局得分范围为0.768至0.930，子量表得分范围为0.615至0.907，发现其对社会人口统计学和方法学特征敏感；（ii）可靠性诱导率为47.58%；（iii）几乎没有对α正确适用性所需假设进行检验。数据不可用妨碍了按时间稳定性提供汇总的可靠性估计。
这些发现凸显了在初级研究中提高PE自我报告工具分数可靠性报告的必要性。这意味着既要为所采用指标的适当性提供事先理由，也要为所有感兴趣的亚群体提供可靠性数据。所呈现的值既可以用作与未来初级研究中获得的值进行比较的参考，也可以用于纠正关于PE的定量元分析研究中与测量相关的假象。
