Hou Yukang, Xie Qingsheng, Zhang Ning, Lv Jian
Key Laboratory of Advanced Manufacturing Technology of the Ministry of Education, Guizhou University, Guiyang, 550025, China.
Sci Rep. 2025 Apr 21;15(1):13732. doi: 10.1038/s41598-025-98891-3.
Evaluating cognitive load in mixed reality (MR) has become a significant challenge in human-computer interaction (HCI). To address this, we established an MR multimodal experimental platform with three distinct environments to induce varying levels of cognitive load. Participants engaged in MR-based CNC machine tool interaction tasks within these environments. Using the built-in sensors of the HoloLens 2 mixed reality head-mounted display (MR-HMD) and wearable heart rate sensors, we collected device and physiological data from participants wearing the MR-HMD while performing these tasks. The cognitive load of participants was assessed by using the NASA-TLX questionnaire. Experimental results indicated that the operation time required in the MR environment increased by 49% under high cognitive load compared to low-load conditions. High-load environments also led to increased anxiety, frustration, and decreased performance among participants. Through comparative experiments, we identified suitable sensor data streams and algorithms for cognitive load classification and designed an MR digital twin factory cognitive load warning prototype system. This system utilizes an improved Transformer-CL algorithm, achieving a cognitive load classification accuracy of 95.83%. The system provides high cognitive load warnings, reducing the risks associated with high cognitive load tasks in MR work environments.
IEEE Trans Vis Comput Graph. 2017-8-10
Sensors (Basel). 2021-12-26
IEEE J Biomed Health Inform. 2019-1-18
J Neuroeng Rehabil. 2024-11-1
IEEE Int Conf Rehabil Robot. 2019-6
IEEE Trans Vis Comput Graph. 2025-5
IEEE Trans Neural Syst Rehabil Eng. 2023
J Clin Monit Comput. 2023-8
Bioengineering (Basel). 2023-3-15
Int J Environ Res Public Health. 2023-1-9