• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

评估中的标准与可靠性:当经验法则不适用时。

Standards and reliability in evaluation: when rules of thumb don't apply.

作者信息

Norcini J J

机构信息

Institute for Clinical Evaluation, American Board of Internal Medicine, Philadelphia, Pennsylvania 19106-3699, USA.

出版信息

Acad Med. 1999 Oct;74(10):1088-90. doi: 10.1097/00001888-199910000-00010.

DOI:10.1097/00001888-199910000-00010
PMID:10536629
Abstract

The purpose of this paper is to identify situations in which two rules of thumb in evaluation do not apply. The first rule is that all standards should be absolute. When selection decisions are being made or when classroom tests are given, however, relative standards may be better. The second rule of thumb is that every test should have a reliability of .80 or better. Depending on the circumstances, though, the standard error of measurement, the consistency of pass/fail classifications, and the domain-referenced reliability coefficients may be better indicators of reproducibility.

摘要

本文的目的是识别评估中的两条经验法则不适用的情况。第一条法则是所有标准都应该是绝对的。然而,在做出选拔决定或进行课堂测试时,相对标准可能更好。第二条经验法则是每个测试的信度应该达到0.80或更高。不过,根据具体情况,测量标准误差、通过/失败分类的一致性以及领域参照信度系数可能是再现性的更好指标。

相似文献

1
Standards and reliability in evaluation: when rules of thumb don't apply.评估中的标准与可靠性:当经验法则不适用时。
Acad Med. 1999 Oct;74(10):1088-90. doi: 10.1097/00001888-199910000-00010.
2
A plea for the proper use of criterion-referenced tests in medical assessment.呼吁正确使用医学评估中的准则参照测验。
Med Educ. 2009 Dec;43(12):1141-6. doi: 10.1111/j.1365-2923.2009.03541.x.
3
Setting and maintaining standards in multiple choice examinations: AMEE Guide No. 37.多项选择题考试中的标准设定与维持:医学教育与培训学会指南第37号
Med Teach. 2008;30(9-10):836-45. doi: 10.1080/01421590802402247.
4
Why don't trainees pass the emergency medicine fellowship examination?为什么住院医师没有通过急诊医学专科 fellowship 考试?
Emerg Med Australas. 2004 Aug;16(4):336-42. doi: 10.1111/j.1742-6723.2004.00621.x.
5
How sure can we be that a student really failed? On the measurement precision of individual pass-fail decisions from the perspective of Item Response Theory.我们能多确定一个学生是真的不及格了?从项目反应理论的角度来看个体通过/失败决策的测量精度。
Med Teach. 2020 Dec;42(12):1374-1384. doi: 10.1080/0142159X.2020.1811844. Epub 2020 Aug 28.
6
How effective are selection methods in medical education? A systematic review.医学教育中的选择方法有多有效?系统评价。
Med Educ. 2016 Jan;50(1):36-60. doi: 10.1111/medu.12817.
7
Portfolios for determining initial licensure competency.
J Am Dent Assoc. 2004 Feb;135(2):173-84. doi: 10.14219/jada.archive.2004.0149.
8
The impact of an alternative approach to construct definition upon the reliability and utility of diagnostic performance measures.构建定义的替代方法对诊断性能指标的可靠性和实用性的影响。
Acad Med. 1998 Oct;73(10 Suppl):S100-2. doi: 10.1097/00001888-199810000-00059.
9
A comment on specialty board examinations: they don't use multiple-choice tests to license airline pilots.
Forum Med. 1980 Jul;3(7):467-9.
10
Educational testing and validity of conclusions in the scholarship of teaching and learning.教育测试与教学学术结论的有效性。
Am J Pharm Educ. 2013 Nov 12;77(9):186. doi: 10.5688/ajpe779186.

引用本文的文献

1
Inter-rater reliability and validity of supervision performance assessment and recognition (SPARS) indicators to assess medicines management in public health facilities in Nepal.尼泊尔公共卫生机构药品管理监督绩效评估与认可(SPARS)指标的评分者间信度与效度
J Pharm Policy Pract. 2025 Mar 24;18(1):2477098. doi: 10.1080/20523211.2025.2477098. eCollection 2025.
2
Who, when, where, and why: A systematic review of "late diagnosis" in autism.何人、何时、何地以及为何:关于自闭症“延迟诊断”的系统评价。
Autism Res. 2025 Jan;18(1):22-36. doi: 10.1002/aur.3278. Epub 2024 Nov 23.
3
Exploring the use of Rasch modelling in "common content" items for multi-site and multi-year assessment.
探索拉施模型在多站点和多年评估的“通用内容”项目中的应用。
Adv Health Sci Educ Theory Pract. 2025 Apr;30(2):427-438. doi: 10.1007/s10459-024-10354-y. Epub 2024 Jul 8.
4
Forced labour risk is pervasive in the US land-based food supply.美国陆地食品供应中普遍存在强迫劳动风险。
Nat Food. 2023 Jul;4(7):596-606. doi: 10.1038/s43016-023-00794-x. Epub 2023 Jul 24.
5
Verbal and visual serial-order memory in deaf signers and hearing nonsigners: A systematic review and meta-analysis.聋人手语使用者与听力正常的非手语使用者的言语和视觉序列记忆:一项系统综述和荟萃分析。
Psychon Bull Rev. 2023 Oct;30(5):1722-1739. doi: 10.3758/s13423-023-02282-6. Epub 2023 Apr 3.
6
Comparing Standard Setting Methods for Objective Structured Clinical Examinations in a Caribbean Medical School.加勒比地区一所医学院客观结构化临床考试标准设定方法的比较
J Med Educ Curric Dev. 2020 Dec 28;7:2382120520981992. doi: 10.1177/2382120520981992. eCollection 2020 Jan-Dec.
7
Optimizing assessments of post-error slowing: A neurobehavioral investigation of a flanker task.优化对错误后减速的评估:一项关于侧抑制任务的神经行为研究。
Psychophysiology. 2020 Feb;57(2):e13473. doi: 10.1111/psyp.13473. Epub 2019 Sep 19.
8
Inter-rater reliability and validity of good pharmacy practices measures in inspection of public sector health facility pharmacies in Uganda.乌干达公共部门卫生机构药房检查中良好药房实践措施的评分者间信度和效度
J Pharm Policy Pract. 2019 Jan 22;12:2. doi: 10.1186/s40545-018-0161-y. eCollection 2019.
9
Evaluating inter-rater reliability of indicators to assess performance of medicines management in health facilities in Uganda.评估乌干达医疗机构药品管理绩效评估指标的评分者间信度。
J Pharm Policy Pract. 2018 May 3;11:11. doi: 10.1186/s40545-018-0137-y. eCollection 2018.
10
How to set the bar in competency-based medical education: standard setting after an Objective Structured Clinical Examination (OSCE).如何在基于胜任力的医学教育中设定标准:客观结构化临床考试(OSCE)后的标准设定。
BMC Med Educ. 2016 Jan 4;16:1. doi: 10.1186/s12909-015-0506-z.