School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China.
Engineering Research Center of Intelligent Technology and Educational Application, Ministry of Education, Beijing 100875, China.
Sensors (Basel). 2021 Jan 1;21(1):241. doi: 10.3390/s21010241.
In-class teaching evaluation, which is utilized to assess the process and effect of both teachers' teaching and students' learning in a classroom environment, plays an increasingly crucial role in supervising and promoting education quality. With the rapid development of artificial intelligence (AI) technology, the concept of smart education has been constantly improved and gradually penetrated into all aspects of education application. Considering the dominant position of classroom teaching in elementary and undergraduate education, the introduction of AI technology into in-class teaching evaluation has become a research hotspot. In this paper, we propose a statistical modeling and ensemble learning-based comprehensive model, which is oriented towards in-class teaching evaluation by using AI technologies such as computer vision (CV) and intelligent speech recognition (ISR). Firstly, we present an index system including a set of teaching evaluation indicators combining traditional assessment scales with new values derived from CV and ISR-based AI analysis. Next, we design a comprehensive in-class teaching evaluation model by using both the analytic hierarchy process-entropy weight (AHP-EW) and AdaBoost-based ensemble learning (AdaBoost-EL) methods. Experiments not only demonstrate that the two modules in the model are respectively applicable to the calculation of indicators with different characteristics, but also verify the performance of the proposed model for AI-based in-class teaching evaluation. In this comprehensive in-class evaluation model, for students' concentration and participation, ensemble learning module is chosen with less root mean square error () of 8.318 and 9.375. In addition, teachers' media usage and teachers' type evaluated by statistical modeling module approach higher accuracy with 0.905 and 0.815. Instead, the ensemble learning approaches the accuracy of 0.73 in evaluating teachers' style, which performs better than the statistical modeling module with the accuracy of 0.69.
课堂教学评价是评估课堂环境中教师教学和学生学习过程和效果的一种方法,在监督和促进教育质量方面发挥着越来越重要的作用。随着人工智能 (AI) 技术的快速发展,智能教育的概念不断得到改进,并逐渐渗透到教育应用的各个方面。考虑到课堂教学在基础教育和本科教育中的主导地位,将 AI 技术引入课堂教学评价已成为研究热点。在本文中,我们提出了一种基于统计建模和集成学习的综合模型,该模型通过使用计算机视觉 (CV) 和智能语音识别 (ISR) 等 AI 技术,面向课堂教学评价。首先,我们提出了一个指标体系,该体系包括一组教学评估指标,这些指标将传统评估量表与源自 CV 和 ISR 基于 AI 分析的新值相结合。接下来,我们使用层次分析法-熵权法 (AHP-EW) 和基于 AdaBoost 的集成学习 (AdaBoost-EL) 方法设计了一个综合课堂教学评价模型。实验不仅证明了模型中的两个模块分别适用于计算具有不同特征的指标,还验证了所提出的 AI 支持的课堂教学评价模型的性能。在这个综合课堂评价模型中,对于学生的注意力和参与度,选择了集成学习模块,其均方根误差 () 为 8.318 和 9.375。此外,统计建模模块评估的教师媒体使用情况和教师类型具有较高的准确性,分别为 0.905 和 0.815。相比之下,集成学习在评估教师风格方面的准确性接近 0.73,优于统计建模模块的准确性 0.69。