Yu Ji-Eun
Research Institute of Sports and Industry Science, Hanseo University, Seosan, Korea.
Department of Physical Education, Korea University, Seoul, Korea.
J Exerc Rehabil. 2025 Aug 31;21(4):200-209. doi: 10.12965/jer.2550428.214. eCollection 2025 Aug.
This study aimed to evaluate the reliability and validity of the Kirkpatrick four-level questionnaire-comprising reaction (R), learning (L), behavior (B), and results (Res)-in the context of an exercise rehabilitation program. A total of 141 university students, aged 21 to 25, participated in a 15-week exercise rehabilitation program. Intrarater reliability was assessed using the intraclass correlation coefficient (ICC) in a pre-posttest setup and analyzed through Bland-Altman plots. Convergent validity was examined using Pearson correlation. The results of this study were as follows. 'R,' consisting of six questions, showed an ICC ranging from 0.954 to 0.990. 'L,' composed of seven questions, demonstrated an ICC between 0.883 and 0.978. 'B,' made up of five questions, displayed an ICC ranging from 0.859 to 0.974. Additionally, 'Res,' consisting of five questions, showed an ICC between 0.834 and 0.926. Significant correlations were observed among all 23 items (<0.001), suggesting that the application of the Kirkpatrick model to evaluate the exercise rehabilitation program demonstrates strong reliability and validity. These findings suggest that the evaluation metrics can effectively monitor program outcomes at each level through the application of the Kirkpatrick model.
本研究旨在评估柯克帕特里克四级问卷(包括反应(R)、学习(L)、行为(B)和结果(Res))在运动康复计划背景下的信度和效度。共有141名年龄在21至25岁之间的大学生参加了为期15周的运动康复计划。在前后测试设置中使用组内相关系数(ICC)评估评分者内信度,并通过布兰德-奥特曼图进行分析。使用皮尔逊相关系数检验收敛效度。本研究结果如下。由六个问题组成的“R”,ICC范围为0.954至0.990。由七个问题组成的“L”,ICC在0.883至0.978之间。由五个问题组成的“B”,ICC范围为0.859至0.974。此外,由五个问题组成的“Res”,ICC在0.834至0.926之间。在所有23个项目之间均观察到显著相关性(<0.001),这表明应用柯克帕特里克模型评估运动康复计划具有很强的信度和效度。这些发现表明,通过应用柯克帕特里克模型,评估指标可以有效地监测每个层面的计划成果。