Department of Physical Therapy, Saitama Prefectural University, Koshigaya, Saitama, Japan.
PLoS One. 2024 Aug 15;19(8):e0308973. doi: 10.1371/journal.pone.0308973. eCollection 2024.
KOJI AWARENESS is a newly developed self-rating whole-body movement assessment system that includes 11 domains and 22 tests. The primary aim of this study was to investigate the intersession reliability of KOJI AWARENESS, and the secondary aim was to determine whether a fixed bias existed between self-rating and external examiner rating. Fifty university students rated their movement ability in two separate sessions; an external examiner also rated the students' movement ability. Participants were blinded to their scores at the first session as well as the external examiner's rating scores. The primary analysis included examining the intersession reliability of the total score with intraclass correlation coefficients (ICCs). ICC values were interpreted as follows: insufficient, < .7 and sufficient, ≥ .7. To achieve the secondary aim, Bland-Altman analysis was performed. ICC for the intersession reliability was .86 with a 95% confidence interval (CI) of .77 to .92 and a minimum detectable change (MDC) of 5.15. Bland-Altman analysis revealed fixed bias as the 95% CIs of the mean difference between the two different rating scores (-3.49 to -2.43 and -3.94 to -2.98 in the first and second sessions, respectively) did not include 0 in the data of each session. However, no proportional bias was identified because no statistically significant Pearson's correlation (P > .05) was noted between the means of the two methods and the mean difference between the two different methods in each session. This study identified that KOJI AWARENESS has sufficient intersession reliability among relatively young and healthy participants. External examiner rating tended to have lower total scores than self-rating; however, the bias was below the MDC and seemed not to be clinically significant.
KOJI 意识是一种新开发的自我评估全身运动评估系统,包括 11 个领域和 22 项测试。本研究的主要目的是调查 KOJI 意识的组内可靠性,次要目的是确定自我评估和外部评估者评估之间是否存在固定偏差。50 名大学生在两次不同的会议中评估自己的运动能力;外部评估者还评估了学生的运动能力。参与者在第一次会议上以及外部评估者的评分上都对自己的分数一无所知。主要分析包括使用组内相关系数(ICC)检查总分的组内可靠性。ICC 值的解释如下:不足,<.7 和充足,≥.7。为了实现次要目的,进行了 Bland-Altman 分析。组内可靠性的 ICC 值为.86,95%置信区间(CI)为.77 至.92,最小可检测变化(MDC)为 5.15。Bland-Altman 分析显示存在固定偏差,因为两次不同评分之间的平均差异的 95%CI(第一次和第二次会议分别为-3.49 至-2.43 和-3.94 至-2.98)在每次会议的数据中均不包括 0。然而,由于两次方法的平均值之间没有统计学上显著的 Pearson 相关性(P >.05),也没有在每次会议的两种方法的平均值之间发现比例偏差。本研究表明,KOJI 意识在相对年轻和健康的参与者中具有足够的组内可靠性。外部评估者的评分往往低于自我评估;然而,偏差低于 MDC,似乎没有临床意义。