Mahoney Danielle, Alvarado Stephanie, Mendonca Rochelle
Department of Rehabilitation and Regenerative Medicine, Programs in Occupational Therapy, Columbia University, New York, NY 10032, USA.
WellCare Pediatric Therapy, Colorado Springs, CO 80915, USA.
Brain Sci. 2025 May 16;15(5):511. doi: 10.3390/brainsci15050511.
Functional cognitive impairments caused by acquired brain injury (ABI) negatively impact an individual's daily functioning. Impaired self-awareness can pose obstacles to task execution and participation. Traditional assessment methods for self-awareness lack a functional approach, highlighting the need for performance-based assessments such as the Occupational Therapy Anticipatory Awareness Test (OTAAT). The purpose of this study was to establish the interrater reliability of the OTAAT in adults with ABI. This was a two-phase study. Phase One involved the recruitment of three participants with ABI, who then underwent OTAAT administration within a setting of their choosing. OTAAT performances were recorded. In Phase Two, ten occupational therapists assessed the Phase One participants' performances using the OTAAT. Phase Two's raters' outcomes were obtained by research personnel. These data were then collected and analyzed by research staff to measure interrater reliability using the Intraclass Correlation Coefficient (ICC) via IBM Statistical Package for the Social Sciences (SPSS) software. A two-way random effect, absolute agreement, multiple-rater/measurement ICC was adopted for this study. Data analysis demonstrated strong interrater reliability for the OTAAT, demonstrating its consistency to measure self-awareness in individuals with ABI across different raters. Specifically, the ICC values indicated strong agreement among raters in their assessment of participants' self-awareness performance using the OTAAT. The OTAAT has strong interrater reliability and holds promise as a valuable addition to neurorehabilitation practice. This study demonstrates the reliability of the OTAAT as a tool for assessing self-awareness in the ABI population.
后天性脑损伤(ABI)导致的功能性认知障碍会对个体的日常功能产生负面影响。自我意识受损会给任务执行和参与造成障碍。传统的自我意识评估方法缺乏功能性视角,这凸显了基于表现的评估方法的必要性,例如职业治疗预期意识测试(OTAAT)。本研究的目的是确定OTAAT在患有ABI的成年人中的评分者间信度。这是一项分两阶段的研究。第一阶段招募了三名患有ABI的参与者,然后让他们在自己选择的环境中接受OTAAT测试。记录OTAAT测试的表现。在第二阶段,十名职业治疗师使用OTAAT对第一阶段参与者的表现进行评估。第二阶段评分者的结果由研究人员获取。然后研究人员收集并分析这些数据,通过IBM社会科学统计软件包(SPSS)使用组内相关系数(ICC)来测量评分者间信度。本研究采用双向随机效应、绝对一致性、多评分者/测量ICC。数据分析表明OTAAT具有很强的评分者间信度,证明了其在不同评分者之间测量ABI个体自我意识的一致性。具体而言,ICC值表明评分者在使用OTAAT评估参与者自我意识表现方面具有很强的一致性。OTAAT具有很强的评分者间信度,有望成为神经康复实践中有价值的补充。本研究证明了OTAAT作为评估ABI人群自我意识工具的可靠性。