Basic Medical College, Shaanxi University of Chinese Medicine, Xianyang 712046, Shaanxi, China.
Shaanxi Key Laboratory of Chinese Medicine Encephalopathy, Shaanxi University of Chinese Medicine, Xianyang 712046, Shaanxi, China.
J Healthc Eng. 2021 Jun 7;2021:9998427. doi: 10.1155/2021/9998427. eCollection 2021.
AR/VR technology can fuse the clinical imaging data and information to build an anatomical environment combining virtual and real, which is helpful to improve the interest of teaching and the learning initiative of medical students, and then improve the effect of clinical teaching. This paper studies the application and learning effect of the VR/AR system in human anatomy surgery teaching. This paper first shows the learning environment and platform of the VR/AR system, then explains the interface and operation of the system, and evaluates the teaching situation. This paper takes the VR/AR operation simulation system of an Irish company as an example and evaluates the learning effect of 41 students in our hospital. Research shows that the introduction of the feature reweighting module in the VR/AR surgery simulation system improves the accuracy of bone structure segmentation (IOU value increases from 79.62% to 83.56%). For real human ultrasound image data, the IOU value increases from 80.21% to 82.23% after the feature reweighting module is introduced. Therefore, the dense convolution module and feature reweighting module improve the learning ability of the network for bone structure features in ultrasound images from two aspects of feature connection and importance understanding and effectively improve the performance of bone structure segmentation.
AR/VR 技术可以融合临床影像数据和信息,构建虚实结合的解剖环境,有助于提高教学趣味性和医学生学习积极性,从而提高临床教学效果。本文研究了 VR/AR 系统在人体解剖手术教学中的应用和学习效果。本文首先展示了 VR/AR 系统的学习环境和平台,然后解释了系统的界面和操作,并对教学情况进行了评估。本文以一家爱尔兰公司的 VR/AR 操作模拟系统为例,对我院 41 名学生的学习效果进行了评估。研究表明,在 VR/AR 手术模拟系统中引入特征加权模块提高了骨结构分割的准确性(IOU 值从 79.62%提高到 83.56%)。对于真实的人体超声图像数据,引入特征加权模块后,IOU 值从 80.21%提高到 82.23%。因此,密集卷积模块和特征加权模块从特征连接和重要性理解两个方面提高了网络对超声图像中骨结构特征的学习能力,有效提高了骨结构分割的性能。