Suppr超能文献

基于举手视频的学生动机分析。

Student Motivation Analysis Based on Raising-Hand Videos.

机构信息

School of Electronics and Communications Engineering, Sun Yat-sen University, Shenzhen 518107, China.

School of Education, South China Normal University, Guangzhou 510898, China.

出版信息

Sensors (Basel). 2024 Jul 17;24(14):4632. doi: 10.3390/s24144632.

Abstract

In current smart classroom research, numerous studies focus on recognizing hand-raising, but few analyze the movements to interpret students' intentions. This limitation hinders teachers from utilizing this information to enhance the effectiveness of smart classroom teaching. Assistive teaching methods, including robotic and artificial intelligence teaching, require smart classroom systems to both recognize and thoroughly analyze hand-raising movements. This detailed analysis enables systems to provide targeted guidance based on students' hand-raising behavior. This study proposes a morphology-based analysis method to innovatively convert students' skeleton key point data into several one-dimensional time series. By analyzing these time series, this method offers a more detailed analysis of student hand-raising behavior, addressing the limitations of deep learning methods that cannot compare classroom hand-raising enthusiasm or establish a detailed database of such behavior. This method primarily utilizes a neural network to obtain students' skeleton estimation results, which are then converted into time series of several variables using the morphology-based analysis method. The YOLOX and HrNet models were employed to obtain the skeleton estimation results; YOLOX is an object detection model, while HrNet is a skeleton estimation model. This method successfully recognizes hand-raising actions and provides a detailed analysis of their speed and amplitude, effectively supplementing the coarse recognition capabilities of neural networks. The effectiveness of this method has been validated through experiments.

摘要

在当前的智能课堂研究中,许多研究都集中在识别举手行为上,但很少有研究分析这些动作以解释学生的意图。这种局限性阻碍了教师利用这些信息来提高智能课堂教学的效果。辅助教学方法,包括机器人和人工智能教学,都需要智能课堂系统既能够识别,又能够全面分析举手动作。这种详细的分析使系统能够根据学生的举手行为提供有针对性的指导。本研究提出了一种基于形态学的分析方法,将学生的骨骼关键点数据创新性地转换为几个一维时间序列。通过分析这些时间序列,该方法可以更详细地分析学生举手行为,解决了深度学习方法无法比较课堂举手积极性或建立此类行为的详细数据库的局限性。该方法主要利用神经网络获取学生的骨骼估计结果,然后使用基于形态学的分析方法将其转换为几个变量的时间序列。该方法使用了 YOLOX 和 HrNet 模型来获取骨骼估计结果;YOLOX 是一个目标检测模型,而 HrNet 是一个骨骼估计模型。该方法成功地识别了举手动作,并对其速度和幅度进行了详细分析,有效地补充了神经网络的粗略识别能力。该方法通过实验得到了验证。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0e6a/11280924/377760df0db9/sensors-24-04632-g001.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验