Ni Zhaoheng, Yuksel Ahmet Cem, Ni Xiuyan, Mandel Michael I, Xie Lei
The Graduate Center, City University of New York, New York, NY 10016, USA.
Brooklyn College, City University of New York, Brooklyn, NY 11210, USA.
ACM BCB. 2017 Aug;2017:241-246. doi: 10.1145/3107411.3107513.
Brain fog, also known as confusion, is one of the main reasons for low performance in the learning process or any kind of daily task that involves and requires thinking. Detecting confusion in a human's mind in real time is a challenging and important task that can be applied to online education, driver fatigue detection and so on. In this paper, we apply Bidirectional LSTM Recurrent Neural Networks to classify students' confusion in watching online course videos from EEG data. The results show that Bidirectional LSTM model achieves the state-of-the-art performance compared with other machine learning approaches, and shows strong robustness as evaluated by cross-validation. We can predict whether or not a student is confused in the accuracy of 73.3%. Furthermore, we find the most important feature to detecting the brain confusion is the gamma 1 wave of EEG signal. Our results suggest that machine learning is a potentially powerful tool to model and understand brain activity.
脑雾,也称为思维混乱,是学习过程中或任何涉及并需要思考的日常任务中表现不佳的主要原因之一。实时检测人类大脑中的思维混乱是一项具有挑战性且重要的任务,可应用于在线教育、驾驶员疲劳检测等领域。在本文中,我们应用双向长短期记忆循环神经网络,根据脑电图(EEG)数据对学生观看在线课程视频时的思维混乱情况进行分类。结果表明,与其他机器学习方法相比,双向长短期记忆模型达到了最优性能,并且通过交叉验证评估显示出很强的稳健性。我们能够以73.3%的准确率预测学生是否处于思维混乱状态。此外,我们发现检测大脑思维混乱最重要的特征是EEG信号的伽马1波。我们的结果表明,机器学习是建模和理解大脑活动的潜在强大工具。