Department of Emergency Medicine, Kyung Hee University Hospital, Seoul, Korea.
Department of Medical Education and Medical Humanities, Kyung Hee University School of Medicine, Seoul, Korea.
Korean J Med Educ. 2020 Sep;32(3):213-221. doi: 10.3946/kjme.2020.172. Epub 2020 Sep 1.
This study aims to understand the characteristics of smart device-based testing (SBT) by comparing the typical characteristics of students' satisfaction with SBT, its usefulness, advantages, and disadvantages when compared with existing testing methods.
A total of 250 students from the first to third year were selected as the final targets of the study and the questionnaire was developed by faculty members who participated in the survey from the start of the SBT. The total number of questions is 12, and the questionnaire used a 4-point scale. The data obtained were analyzed using the IBM SPSS ver. 23.0 (IBM Corp., Armonk, USA).
Answers to the "satisfaction with SBT" were generally negative, while answers to the "usefulness of SBT" were generally positive. There was no difference in satisfaction across gender and smart device ownership, whereas there were significant differences across years. With reference to the usefulness of SBT, students responded positively, while about the overall configuration and completeness of SBT, students responded negatively. Students also seemed to show a greater preference toward the pencil-paper test.
On the other hand, students generally thought that SBT helped to assess medical knowledge better and was a more objective method of knowledge assessment than a pencil-paper test. We believe that students preferred the traditional paper-pencil test due to their unfamiliarity with SBT. We believe that an appropriate and careful remedy for drawbacks of the SBT will have a significant impact in the accumulation of actual clinical knowledge and in the improvement of practical skills for medical students.
本研究旨在通过比较学生对基于智能设备测试（SBT）的满意度、其有用性、相对于现有测试方法的优势和劣势的典型特征，来了解 SBT 的特点。
共选择了 250 名来自一至三年级的学生作为研究的最终目标，由参与 SBT 调查的教师组成员制定问卷。问题总数为 12 个，问卷采用 4 点量表。使用 IBM SPSS ver. 23.0（IBM 公司，美国阿蒙克）对获得的数据进行分析。
对于“对 SBT 的满意度”的回答普遍为否定，而对于“对 SBT 的有用性”的回答则普遍为肯定。性别和智能设备拥有情况对满意度没有影响，但年级之间存在显著差异。参考 SBT 的有用性，学生的回答是肯定的，而对于 SBT 的整体配置和完整性，学生的回答是否定的。学生似乎也更倾向于纸笔考试。
另一方面，学生普遍认为 SBT 有助于更好地评估医学知识，并且比纸笔考试更能客观地评估知识。我们认为，学生对 SBT 不熟悉，因此更喜欢传统的纸笔考试。我们相信，对 SBT 的缺陷进行适当和谨慎的补救，将对医学生实际临床知识的积累和实践技能的提高产生重大影响。
