巴西客观结构化技术技能评估的验证

Validation of the Objective Structured Assessment of Technical Skill in Brasil.

作者信息

Campos Marcelo Esteves Chaves, Oliveira Marcelo Magaldi Ribeiro de, Assis Lilian Bambirra de, Reis Augusto Barbosa, Gonçalves Flávio Bambirra

机构信息

. Universidade Federal de Minas Gerais, Belo Horizonte, MG, Brasil.

. Centro Federal de Educação Tecnológica de Minas Gerais, Belo Horizonte, MG, Brasil.

出版信息

Rev Assoc Med Bras (1992). 2020 Mar;66(3):328-333. doi: 10.1590/1806-9282.66.3.328.

DOI:10.1590/1806-9282.66.3.328

PMID:32520153

Abstract

BACKGROUND

The aim of this study was to perform a cross-cultural adaptation of the Objective Structured Assessment of Technical Skill (OSATS) tool into Brazilian Portuguese and to determine its reproducibility and validity in Brasil.

METHODS

A Brazilian Portuguese version of OSATS was created through a process of translation, back-translation, expert panel evaluation, pilot testing, and then its validation. For the construct and the concurrent validities, twelve participants were divided into a group of six experts and six novices, who had to perform tasks on a simulation model using human placentas. Each participant was filmed, and two blinded raters would then evaluate their performance using the traditional subjective method and then the Brazilian Portuguese version of OSATS.

RESULTS

The Brazilian Portuguese version of OSATS had the face, content, construct, and concurrent validities achieved. The average experts' score and standard deviations were 34 and 0.894, respectively, for Judge 1 and 34.33 and 0.816 for Judge 2. In the case of novices, it was 13.33 and 2.388 for Judge 1 and 13.33 and 3.204 for Judge 2. The concordance between the judges was evident, with the Correlation Coefficient (Pearson) of 0.9944 with CI 95% between 0.9797 and 0.9985, with p < 10-10, evidencing the excellent reproducibility of the instrument.

CONCLUSION

This preliminary study suggests that the Brazilian Portuguese version of OSATS can reliably and validly assess surgical skills in Brasil.

摘要

背景

本研究旨在将客观结构化技术技能评估（OSATS）工具进行跨文化改编为巴西葡萄牙语，并确定其在巴西的可重复性和有效性。

方法

通过翻译、回译、专家小组评估、预试验，然后进行验证的过程创建了巴西葡萄牙语版的OSATS。为了验证结构效度和同时效度，12名参与者被分为一组6名专家和一组6名新手，他们必须在使用人类胎盘的模拟模型上执行任务。对每个参与者进行拍摄，然后两名盲法评分者将使用传统主观方法，然后使用巴西葡萄牙语版的OSATS评估他们的表现。

结果

巴西葡萄牙语版的OSATS实现了表面效度、内容效度、结构效度和同时效度。对于评判1，专家的平均得分和标准差分别为34和0.894，对于评判2为34.33和0.816。在新手的情况下，评判1为13.33和2.388，评判2为13.33和3.204。评判之间的一致性很明显，相关系数（皮尔逊）为0.9944，95%置信区间在0.9797和0.9985之间，p<10-10，证明了该工具具有出色的可重复性。