Department of Physiology, School of Medical Sciences, The University of New South Wales, Sydney, New South Wales, Australia.
Adv Physiol Educ. 2013 Jun;37(2):192-200. doi: 10.1152/advan.00092.2012.
Online formative assessments have become increasingly popular; however, formal evidence supporting their educational benefits is limited. This study investigated the impact of online feedback quizzes on the learning experiences and outcomes of undergraduate students enrolled in an introductory physiology course. Four quiz models were tested, which differed in the amount of credit available, the number of attempts permitted, and whether the quizzes were invigilated or unsupervised, timed or untimed, or open or closed book. All quizzes were composed of multiple-choice questions and provided immediate individualized feedback. Summative end-of-course examination marks were analyzed with respect to performance in quizzes and were also compared with examination performance in the year before the quizzes were introduced. Online surveys were conducted to gather students' perceptions regarding the quizzes. The vast majority of students perceived online quizzes as a valuable learning tool. For all quiz models tested, there was a significant relationship between performance in quizzes and end-of-course examination scores. Importantly, students who performed poorly in quizzes were more likely to fail the examination, suggesting that formative online quizzes may be a useful tool to identify students in need of assistance. Of the four quiz models, only one quiz model was associated with a significant increase in mean examination performance. This model had the strongest formative focus, allowing multiple unsupervised and untimed attempts. This study suggests that the format of online formative assessments is critical in achieving the desired impact on student learning. Specifically, such assessments are most effective when they are low stakes.
在线形成性评估越来越受欢迎;然而,支持其教育效益的正式证据有限。本研究调查了在线反馈测验对参加生理学入门课程的本科生学习经验和学习成果的影响。测试了四种测验模式,它们在可用学分数量、允许尝试的次数、测验是否监考或无人监考、计时或非计时、开卷或闭卷方面有所不同。所有测验均由选择题组成,并提供即时的个性化反馈。根据测验成绩分析了总结性期末考试成绩,并将其与引入测验之前一年的考试成绩进行了比较。通过在线调查收集了学生对测验的看法。绝大多数学生认为在线测验是一种有价值的学习工具。对于所有测试的测验模式,测验成绩与期末成绩之间都存在显著的相关性。重要的是,测验成绩不佳的学生更有可能考试不及格,这表明形成性在线测验可能是识别需要帮助的学生的有用工具。在四种测验模式中,只有一种测验模式与平均考试成绩的显著提高相关。该模式具有最强的形成性重点,允许多次无人监考和非计时尝试。本研究表明,在线形成性评估的形式对于实现学生学习的预期影响至关重要。具体来说,当评估的风险较低时,这种评估最为有效。