Leung Kat, Trevena Lyndal, Waters Donna
Sydney Medical School, University of Sydney, Camperdown, New South Wales, Australia.
Primary healthcare, co-head discipline of general practice, Sydney Medical School, University of Sydney, New South Wales, Australia.
Nurse Res. 2018 Jun 7;26(1):33-40. doi: 10.7748/nr.2018.e1544.
The authors designed the evidence-based nursing practice assessment tool (EBNPAT) to measure the competence of nurses in using the five-step evidence-based practice model: ask, acquire, appraise, apply and assess. However, they needed to assess its content validity to show it is a valid tool. Assessing the content validity of a newly developed measurement scale is often challenging. Although the content validity index (CVI) is widely used in nursing research, it is limited to evaluating the chance of variation in agreement and consistency among reviewers of the content.
To demonstrate the content validity of EBNPAT.
An expert panel of 42 nursing and health academics and researchers evaluated the representativeness, comprehensiveness and clarity of each construct item on EBNPAT. They then rated their agreement on a four-point ordinal scale. The authors used the item-CVI (I-CVI) augmented with the intraclass correlation coefficient (ICC) and Cronbach's to assess the results and determine the content validity of EBNPAT. All I-CVIs for representativeness, comprehensiveness and clarity of the EBNPAT items were greater than 0.9 and the overall agreement and consistency among experts were greater than 0.65. The strengths of this study were the good sample size and the substantial consensus among experts in their view of assessing competence in evidence-based practice.
High content validity of all construct items supports the progression to the next step in psychometric evaluation of EBNPAT.
This paper has demonstrated a sophisticated statistical approach for evaluating content validity that may be of use to developers of measurement scales in the future.
作者设计了基于证据的护理实践评估工具(EBNPAT),以衡量护士运用五步循证实践模型(提问、获取、评价、应用和评估)的能力。然而,他们需要评估该工具的内容效度,以证明其有效性。评估新开发测量量表的内容效度往往具有挑战性。尽管内容效度指数(CVI)在护理研究中被广泛使用,但它仅限于评估内容评审者之间一致性和一致性的变异机会。
证明EBNPAT的内容效度。
由42名护理和健康领域的学者及研究人员组成的专家小组对EBNPAT上每个构建项目的代表性、全面性和清晰度进行了评估。然后,他们在四点有序量表上对自己的一致性进行评分。作者使用项目CVI(I-CVI)并结合组内相关系数(ICC)和克朗巴哈系数来评估结果,并确定EBNPAT的内容效度。EBNPAT项目代表性、全面性和清晰度的所有I-CVI均大于0.9,专家之间的总体一致性和一致性大于0.65。本研究的优势在于样本量充足,且专家们在评估循证实践能力方面达成了高度共识。
所有构建项目的高内容效度支持EBNPAT在心理测量评估中进入下一步。
本文展示了一种复杂的统计方法来评估内容效度,未来可能对测量量表开发者有用。