Faculty of Medicine and Health Sciences, Institute of Health Sciences Education, McGill University, Lady Meredith House, 1110 Pine Avenue West, Montreal, QC, H3A 1A3, Canada.
Department of Surgery, University of Massachusetts Chan Medical School-Baystate, Worcester, USA.
Surg Endosc. 2023 Jul;37(7):5351-5357. doi: 10.1007/s00464-023-10020-1. Epub 2023 Mar 30.
The Fundamentals of Laparoscopy Surgery (FLS) program was launched over 15 years ago. Since then, there has been an exponential rise in advancements of laparoscopy and its uses. In response, we conducted an argument-based validation study of FLS. The purpose of this paper is to exemplify this approach to validation for surgical education researchers using FLS as an illustrative case.
The argument-based approach to validation involves three key actions: (1) developing interpretation and use arguments; (2) research; and (3) building a validity argument. Drawing from the validation study of FLS each step is exemplified.
Qualitative and quantitative data sources from the FLS validity examination study provided evidence that both supported claims, but also generated backing for rebuttals. Some of the key findings were synthesized in a validity argument to illustrate its structure.
The argument-based validation approach described numerous advantages over other validation approaches: (1) it is endorsed by the foundational documents in assessment and evaluation research; (2) its specific language of claims, inferences, warrants, assumptions and rebuttals provides a systematic and unified way to communicate both the processes and outcomes of validation; and (3) the use of logic reasoning in building the validity document clearly delineates the relationship between evidence and the inferences made to support desired uses and interpretations from assessments.
腹腔镜手术基础(FLS)项目启动于 15 年前。自此,腹腔镜技术及其应用得到了飞速发展。有鉴于此,我们对 FLS 进行了基于论证的验证研究。本文旨在通过以 FLS 为例,为外科教育研究人员展示这种验证方法。
基于论证的验证方法包括三个关键步骤:(1)提出解释和使用论证;(2)开展研究;(3)构建有效性论证。本文将结合 FLS 的验证研究逐一说明这些步骤。
从 FLS 有效性检验研究中获得的定性和定量数据为支持和反驳的主张提供了证据。其中一些关键发现被综合在有效性论证中,以说明其结构。
与其他验证方法相比,基于论证的验证方法具有许多优势:(1)它得到了评估和评价研究基础文件的认可;(2)其主张、推理、保证、假设和反驳的特定语言为验证的过程和结果提供了系统而统一的沟通方式;(3)在构建有效性文件时使用逻辑推理,明确了证据与为支持预期用途和解释而进行的推理之间的关系。