Bech Nicoline L, Bartholdy Karoline H, Nielsen Ann N, Brandt Åse
Department of Public Health, University of Southern Denmark, Odense, Denmark.
National Institute of Public Health, University of Southern Denmark, Copenhagen, Denmark.
Br J Occup Ther. 2023 Apr;86(4):302-311. doi: 10.1177/03080226221137770. Epub 2023 Feb 25.
This study investigated the inter-rater reliability of The observed Off-task Behavior among School Children (The OBS-Children), developed to measure observed off-task behavior among children from 6 to 12 years old with sensory processing difficulties and sensory seeking behavior. Two raters rated 18 videos of 10 children in a controlled school-like setting. Inter-rater reliability was calculated using Intraclass Correlation Coefficients (ICCs 2.1). Standard Error of Measurement (SEM) and Limits of Agreement (LoA) were calculated as a parameter of measurement error. Four out of six items had good to excellent reliability (ICC 0.83-0.95), while one had moderate reliability (ICC 0.75) and one had poor reliability (ICC 0.28). SEM was mostly small, while LoA ranged quite widely on all but one item. The reliability of the OBS-Children can be considered acceptable except from two problematic items. Measurement error was relatively large for all items, implying a need for further development and psychometric testing of the tool.
本研究调查了“学龄儿童观察到的任务外行为量表（The OBS-Children）”的评分者间信度，该量表旨在测量6至12岁有感觉统合困难和感觉寻求行为的儿童的观察到的任务外行为。两名评分者在类似学校的受控环境中对10名儿童的18个视频进行了评分。使用组内相关系数（ICC 2.1）计算评分者间信度。计算测量标准误（SEM）和一致性界限（LoA）作为测量误差的参数。六个项目中有四个具有良好到优秀的信度（ICC 0.83 - 0.95），一个具有中等信度（ICC 0.75），一个具有较差信度（ICC 0.28）。SEM大多较小，而除一个项目外，LoA在所有项目上的范围都相当广泛。除了两个有问题的项目外，The OBS-Children的信度可被认为是可接受的。所有项目的测量误差都相对较大，这意味着该工具需要进一步开发和进行心理测量学测试。
