Forrer Mirte L, Schuengel Carlo, Oosterman Mirjam
Vrije Universiteit Amsterdam, Section of Clinical Child and Family Studies, Van der Boechorststraat 7, 1081 BT Amsterdam, the Netherlands.
Amsterdam Public Health Research Institute, Amsterdam, the Netherlands.
PEC Innov. 2025 Jan 20;6:100376. doi: 10.1016/j.pecinn.2025.100376. eCollection 2025 Jun.
Assessment of parent-child interaction by practitioners is of great importance but hindered by a lack of instruments that withstand the constraints daily practice places on usage. Visuals may offer an alternative format. Visualizations were tested on reliability, accuracy, and feasibility in observational assessment of parent-child interaction, as alternatives for textual rating scales.
In Study 1, 95 students rated parent-child interactions with a video or text anchor scale, and in Study 2, 217 professionals rated the same interactions with a decision tree including visual components or a text anchor scale.
Students using the video anchor scale were less reliable and accurate, slower, and had a less positive user experience than students using the text anchor scale. Professionals using the decision tree did not differ in reliability and were comparable in user experience with professionals using the text anchor scale. Rater accuracy showed similar dependency on quality of parental behavior for both scales: ratings were less accurate when the quality of the parent-child interaction was low, and more accurate when the quality was high. However, professionals were less accurate and slower in using the decision tree than the text anchor scale.
With a first iteration of a decision tree performing the same to or only slightly worse, efforts to further develop decision trees might be worthwhile.
These nonintuitive findings underscore the value of experimental testing in assessment design in daily practice.
从业者对亲子互动的评估非常重要，但因缺乏能经受日常实践使用限制的工具而受到阻碍。视觉材料可能提供一种替代形式。作为文本评定量表的替代方法，对可视化材料在亲子互动观察评估中的信度、准确性和可行性进行了测试。
在研究1中，95名学生使用视频或文本锚定量表对亲子互动进行评分，在研究2中，217名专业人员使用包含视觉成分的决策树或文本锚定量表对相同的互动进行评分。
与使用文本锚定量表的学生相比，使用视频锚定量表的学生信度和准确性较低，速度较慢，用户体验也较差。使用决策树的专业人员在信度上没有差异，在用户体验方面与使用文本锚定量表的专业人员相当。两种量表的评分者准确性对父母行为质量的依赖性相似：当亲子互动质量较低时，评分准确性较低，当质量较高时，评分更准确。然而，专业人员使用决策树时比使用文本锚定量表时准确性更低，速度更慢。
决策树的首次迭代表现相同或仅略差，进一步开发决策树的努力可能是值得的。
这些非直观的发现强调了在日常实践评估设计中进行实验测试的价值。
