Rosas Scott R, Ridings John W
Concept Systems, Inc., 136 East State Street, Ithaca, NY 14850, United States.
The Institute for Clinical Social Work, At Robert Morris Center, 401 South State Street, Suite 822 Chicago, IL 60605, United States.
Eval Program Plann. 2017 Feb;60:265-276. doi: 10.1016/j.evalprogplan.2016.08.016. Epub 2016 Aug 28.
The past decade has seen an increase of measurement development research in social and health sciences that featured the use of concept mapping as a core technique. The purpose, application, and utility of concept mapping have varied across this emerging literature. Despite the variety of uses and range of outputs, little has been done to critically review how researchers have approached the application of concept mapping in the measurement development and evaluation process. This article focuses on a review of the current state of practice regarding the use of concept mapping as methodological tool in this process. We systematically reviewed 23 scale or measure development and evaluation studies, and detail the application of concept mapping in the context of traditional measurement development and psychometric testing processes. Although several limitations surfaced, we found several strengths in the contemporary application of the method. We determined concept mapping provides (a) a solid method for establishing content validity, (b) facilitates researcher decision-making, (c) insight into target population perspectives that are integrated a priori, and (d) a foundation for analytical and interpretative choices. Based on these results, we outline how concept mapping can be situated in the measurement development and evaluation processes for new instrumentation.
在过去十年中,社会科学和健康科学领域的测量发展研究有所增加,其特点是以概念图作为核心技术。概念图的目的、应用和效用在这一新兴文献中各不相同。尽管用途多样且产出范围广泛,但对于研究人员在测量发展和评估过程中如何应用概念图进行批判性审查的工作却很少。本文重点回顾了在这一过程中使用概念图作为方法工具的当前实践状况。我们系统地回顾了23项量表或测量工具的开发与评估研究,并详细阐述了概念图在传统测量发展和心理测量测试过程中的应用。尽管出现了一些局限性,但我们发现该方法在当代应用中有几个优点。我们确定概念图提供了:(a)一种建立内容效度的可靠方法;(b)有助于研究人员做出决策;(c)洞察事先整合的目标人群观点;(d)为分析和解释选择奠定基础。基于这些结果,我们概述了概念图如何在新仪器的测量发展和评估过程中定位。