Child Health, TNO (Netherlands Organisation of Applied Scientific Research), Leiden, The Netherlands.
Department of Health Sciences, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands.
Eur J Pediatr. 2024 Apr;183(4):1777-1787. doi: 10.1007/s00431-023-05414-1. Epub 2024 Jan 22.
Questionnaires to detect emotional and behavioral (EB) problems in preventive child healthcare (PCH) should be short; this potentially affects their validity and reliability. Computerized adaptive testing (CAT) could overcome this weakness. The aim of this study was to (1) develop a CAT to measure EB problems among pre-school children and (2) assess the efficiency and validity of this CAT. We used a Dutch national dataset obtained from parents of pre-school children undergoing a well-child care assessment by PCH (n = 2192, response 70%). Data regarded 197 items on EB problems, based on four questionnaires, the Strengths and Difficulties Questionnaire (SDQ), the Child Behavior Checklist (CBCL), the Ages and Stages Questionnaire: Social Emotional (ASQ:SE), and the Brief Infant-Toddler Social and Emotional Assessment (BITSEA). Using 80% of the sample, we calculated item parameters necessary for a CAT and defined a cutoff for EB problems. With the remaining part of the sample, we used simulation techniques to determine the validity and efficiency of this CAT, using as criterion a total clinical score on the CBCL. Item criteria were met by 193 items. This CAT needed, on average, 16 items to identify children with EB problems. Sensitivity and specificity compared to a clinical score on the CBCL were 0.89 and 0.91, respectively, for total problems; 0.80 and 0.93 for emotional problems; and 0.94 and 0.91 for behavioral problems. Conclusion: A CAT is very promising for the identification of EB problems in pre-school children, as it seems to yield an efficient, yet high-quality identification. This conclusion should be confirmed by real-life administration of this CAT. What is Known: • Studies indicate the validity of using computerized adaptive test (CAT) applications to identify emotional and behavioral problems in school-aged children. • Evidence is as yet limited on whether CAT applications can also be used with pre-school children. What is New: • The results of this study show that a computerized adaptive test is very promising for the identification of emotional and behavior problems in pre-school children, as it appears to yield an efficient and high-quality identification.
检测预防儿童保健中的情绪和行为(EB)问题的问卷应该简短;这可能会影响其有效性和可靠性。计算机化自适应测试(CAT)可以克服这一弱点。本研究的目的是:(1)开发一种用于测量学龄前儿童 EB 问题的 CAT;(2)评估这种 CAT 的效率和有效性。我们使用了来自接受预防儿童保健评估的学龄前儿童家长的荷兰国家数据集(n=2192,回应率为 70%)。数据涉及基于四个问卷的 197 项 EB 问题,分别是《长处和困难问卷》(SDQ)、《儿童行为检查表》(CBCL)、《年龄和阶段问卷:社会情感》(ASQ:SE)和《婴儿-学步儿社会和情感评估简表》(BITSEA)。我们使用 80%的样本计算了 CAT 所需的项目参数,并确定了 EB 问题的截止值。使用样本的其余部分,我们使用模拟技术来确定这种 CAT 的有效性和效率,使用 CBCL 的总临床评分作为标准。有 193 个项目符合项目标准。这种 CAT 平均需要 16 个项目来识别有 EB 问题的儿童。与 CBCL 的总临床评分相比,敏感性和特异性分别为 0.89 和 0.91,用于所有问题;0.80 和 0.93 用于情绪问题;0.94 和 0.91 用于行为问题。结论:CAT 非常有希望用于识别学龄前儿童的 EB 问题,因为它似乎能够高效、高质量地识别。这一结论应该通过实际使用这种 CAT 来验证。已知:• 研究表明,使用计算机化自适应测试(CAT)应用程序识别学龄儿童的情绪和行为问题具有有效性。• 目前还没有证据表明 CAT 应用程序也可以用于学龄前儿童。新发现:• 本研究结果表明,计算机化自适应测试对于识别学龄前儿童的情绪和行为问题非常有前景,因为它似乎能够高效、高质量地识别。