Medical Council of Canada, 2283 St. Laurent Blvd., Ottawa, Ontario, Canada.
Eval Health Prof. 2010 Mar;33(1):96-108. doi: 10.1177/0163278709356192. Epub 2009 Dec 29.
Item disclosure is one of the most serious threats to the validity of high stakes examinations, and identifying examinees that may have had unauthorized access to material is an important step in ensuring the integrity of an examination. A procedure was developed to identify examinees that potentially had unauthorized prior access to examination content. A standardized difference score is created by comparing examinee ability estimates for potentially exposed items to ability estimates for unexposed items. Outliers in this distribution are then flagged for further review. The steps associated with this procedure are described and followed by an example of applying the procedure. In addition, the use of this procedure is supported by the results of a simulation that models the use of unauthorized access to examination material.
项目披露是对高风险考试有效性的最严重威胁之一,确定可能未经授权访问材料的考生是确保考试完整性的重要步骤。已经制定了一项程序来识别可能事先未经授权访问考试内容的考生。通过将考生对潜在暴露项目的能力估计与未暴露项目的能力估计进行比较,创建标准化差异分数。然后,对该分布中的异常值进行标记,以便进一步审查。本文描述了该程序的步骤,并附有应用该程序的示例。此外,模拟未经授权使用考试材料的模拟结果也支持该程序的使用。