Chacón-Moscoso Salvador, Sanduvete-Chaves Susana, Lozano-Lozano José Antonio, Holgado-Tello Francisco Pablo
Departamento de Psicología Experimental, Facultad de Psicología, Universidad de Sevilla, Sevilla, Spain.
Departamento de Psicología, Universidad Autónoma de Chile, Santiago, Chile.
Front Psychol. 2023 Jul 6;14:1217661. doi: 10.3389/fpsyg.2023.1217661. eCollection 2023.
A wide variety of instruments are used when assessing the methodological quality (MQ) of intervention programs. Nevertheless, studies on their metric quality are often not available. In order to address this shortcoming, the methodological quality scale (MQS) is presented as a simple and useful tool with adequate reliability, validity evidence, and metric properties.
Two coders independently applied the MQS to a set of primary studies. The number of MQ facets was determined in parallel analyses before performing factor analyses. For each facet of validity obtained, mean and standard deviation are presented jointly with reliability and average discrimination. Additionally, the validity facet scores are interpreted based on Shadish, Cook, and Campbell's validity model.
An empirical validation of the three facets of the MQ (external, internal, and construct validity) and the interpretation of the scores were obtained based on a theoretical framework. Unlike other existing scales, MQS is easy to apply and presents adequate metric properties. In addition, MQ profiles can be obtained in different areas of intervention using different methodologies and proves useful for both researchers doing meta-analysis and for evaluators and professionals designing a new intervention.
在评估干预项目的方法学质量（MQ）时会使用各种各样的工具。然而，关于这些工具的度量质量的研究往往并不存在。为了弥补这一缺陷，方法学质量量表（MQS）作为一种简单且有用的工具被提出，它具有足够的信度、效度证据和度量特性。
两名编码员独立地将MQS应用于一组原始研究。在进行因子分析之前，通过平行分析确定MQ方面的数量。对于获得的每个效度方面，均值和标准差与信度和平均区分度一起呈现。此外，效度方面的得分基于沙迪什、库克和坎贝尔的效度模型进行解释。
基于一个理论框架，对MQ的三个方面（外部效度、内部效度和结构效度）进行了实证验证，并对得分进行了解释。与其他现有量表不同，MQS易于应用且具有足够的度量特性。此外，使用不同方法可以在不同干预领域获得MQ概况，这对进行元分析的研究人员以及设计新干预措施的评估人员和专业人员都很有用。
