利用增强现实和计算机视觉进行医疗保健教育:以药物物质可视化和信息检索为例。
Exploiting Augmented Reality and Computer Vision for Healthcare Education: The Case of Pharmaceutical Substances Visualization and Information Retrieval.
机构信息
Computational Biomedicine Research Lab, Department of Digital Systems, University of Piraeus, Greece.
出版信息
Stud Health Technol Inform. 2022 Aug 31;298:87-91. doi: 10.3233/SHTI220913.
Augmented Reality (AR) is already used as the primary visualization and user interaction tool in several scientific and business areas. At the same time new AR technologies and frameworks considerably facilitate both the development of innovative applications and also their wide adoption in different domains of everyday life. In the area of healthcare AR solutions make use of mobile or wearable devices and glasses to support, among others, education and healthcare professionals training. The aim of this paper is to present a prototype mHealth app for education, which uses AR and computer vision technologies for pharmaceutical substances recognition on drug packaging. The conceptual design of the system includes three main components which are responsible for a) Text recognition, b) Drug identification and c) AR operations for interactivity. The prototype application is available in Android or iOS platforms and has been evaluated in real-world scenarios. Camera and screen of the mobile phones fulfill the text recognition and AR operations, which eliminates the need for special equipment, while PubChem and 3D Model databases provide assets required for the drug identification and AR visualizations. The results highlight the value of AR for educational purposes, especially when combined with advanced image recognition technologies to build interactive AR encyclopedias.
增强现实(AR)已经在多个科学和商业领域中被用作主要的可视化和用户交互工具。与此同时,新的 AR 技术和框架极大地促进了创新应用的开发,也促进了它们在日常生活的不同领域中的广泛应用。在医疗保健领域,AR 解决方案利用移动或可穿戴设备和眼镜来支持医疗保健专业人员的培训等。本文的目的是展示一个用于教育的原型移动医疗(mHealth)应用程序,该应用程序使用 AR 和计算机视觉技术来识别药品包装上的药物物质。系统的概念设计包括三个主要组件,负责 a)文本识别,b)药物识别和 c)用于交互的 AR 操作。原型应用程序可在 Android 或 iOS 平台上使用,并已在实际场景中进行了评估。手机的摄像头和屏幕执行文本识别和 AR 操作,这消除了对特殊设备的需求,而 PubChem 和 3D 模型数据库则提供了药物识别和 AR 可视化所需的资产。结果突出了 AR 在教育方面的价值,特别是当与先进的图像识别技术结合使用时,可以构建交互式 AR 百科全书。