Dongre Amol R, Norcini John
Department of Extension Programmes (SPARSH), Pramukhswami Medical College (PSMC), Karamsad, India.
SUNY Upstate Medical University, Syracuse, New York, USA.
Indian J Community Med. 2021 Jul-Sep;46(3):464-468. doi: 10.4103/ijcm.IJCM_776_20. Epub 2021 Oct 13.
It was to understand the strengths and weaknesses of the current postgraduate assessment system in community medicine in India, to identify recommendations for change, and to build a consensus around them.
A conventional Delphi technique was preferred for consensus building among experts. We completed three Delphi rounds over a period of 4 weeks, and 16 experts participated in the study. Content analysis was done for open-ended responses, and consensus analysis was done for Likert-type scale questionnaire. In round three, we obtained their top five preferences for change in assessment.
The experts agreed to have an assessment system based on ongoing formative and one end-of-year summative assessment. Apart from this, they agreed on the various occasions for carrying out the formative assessment. Furthermore, they clearly agreed on measures such as blueprinting, improving test formats, and adequate briefing of test-taking students.
Most of the consensus items were found to be in alignment with the modern assessment theory. Regulating body and policymakers should revise the current postgraduate assessment system in community medicine to enhance its validity and reliability.
了解印度当前社区医学研究生评估系统的优势与不足，确定变革建议，并就这些建议达成共识。
采用传统德尔菲技术在专家间达成共识。我们在4周内完成了三轮德尔菲调查，16位专家参与了该研究。对开放式回答进行内容分析，对李克特量表问卷进行共识分析。在第三轮中，我们获取了他们对评估变革的前五项偏好。
专家们同意建立一个基于持续形成性评估和一次年终总结性评估的评估系统。除此之外，他们就进行形成性评估的各种时机达成了一致。此外，他们明确就诸如制定蓝图、改进测试形式以及对参加考试的学生进行充分指导等措施达成了一致。
大多数共识项目与现代评估理论相符。监管机构和政策制定者应修订当前社区医学研究生评估系统，以提高其有效性和可靠性。
