文献检索文档翻译深度研究
Suppr Zotero 插件Zotero 插件
邀请有礼套餐&价格历史记录

新学期,新优惠

限时优惠:9月1日-9月22日

30天高级会员仅需29元

1天体验卡首发特惠仅需5.99元

了解详情
不再提醒
插件&应用
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
高级版
套餐订阅购买积分包
AI 工具
文献检索文档翻译深度研究
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2025

多感官扩展现实应用为研究和医学中的体积生物医学图像分析带来了益处。

Multisensory Extended Reality Applications Offer Benefits for Volumetric Biomedical Image Analysis in Research and Medicine.

作者信息

Krieger Kathrin, Egger Jan, Kleesiek Jens, Gunzer Matthias, Chen Jianxu

机构信息

Biospectroscopy, Leibniz-Institut for Analytical Science-ISAS-e.V., Bunsen-Kirchhoff-Str. 11, Dortmund, 44139, NRW, Germany.

Neuroinformatics Group, Faculity of Technology, Bielefeld University, Inspiration 1, Bielefeld, 33619, NRW, Germany.

出版信息

J Imaging Inform Med. 2025 Feb;38(1):646-655. doi: 10.1007/s10278-024-01094-x. Epub 2024 Jun 11.


DOI:10.1007/s10278-024-01094-x
PMID:38862851
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11811323/
Abstract

3D data from high-resolution volumetric imaging is a central resource for diagnosis and treatment in modern medicine. While the fast development of AI enhances imaging and analysis, commonly used visualization methods lag far behind. Recent research used extended reality (XR) for perceiving 3D images with visual depth perception and touch but used restrictive haptic devices. While unrestricted touch benefits volumetric data examination, implementing natural haptic interaction with XR is challenging. The research question is whether a multisensory XR application with intuitive haptic interaction adds value and should be pursued. In a study, 24 experts for biomedical images in research and medicine explored 3D medical shapes with 3 applications: a multisensory virtual reality (VR) prototype using haptic gloves, a simple VR prototype using controllers, and a standard PC application. Results of standardized questionnaires showed no significant differences between all application types regarding usability and no significant difference between both VR applications regarding presence. Participants agreed to statements that VR visualizations provide better depth information, using the hands instead of controllers simplifies data exploration, the multisensory VR prototype allows intuitive data exploration, and it is beneficial over traditional data examination methods. While most participants mentioned manual interaction as the best aspect, they also found it the most improvable. We conclude that a multisensory XR application with improved manual interaction adds value for volumetric biomedical data examination. We will proceed with our open-source research project ISH3DE (Intuitive Stereoptic Haptic 3D Data Exploration) to serve medical education, therapeutic decisions, surgery preparations, or research data analysis.

摘要

来自高分辨率容积成像的3D数据是现代医学诊断和治疗的核心资源。虽然人工智能的快速发展增强了成像和分析能力,但常用的可视化方法却远远落后。最近的研究使用扩展现实(XR)来感知具有视觉深度感知和触觉的3D图像,但使用的是受限的触觉设备。虽然无限制的触摸有利于容积数据检查,但实现与XR的自然触觉交互具有挑战性。研究问题是具有直观触觉交互的多感官XR应用是否具有价值以及是否值得追求。在一项研究中,24位生物医学图像研究和医学领域的专家使用3种应用程序探索了3D医学形状:一种使用触觉手套的多感官虚拟现实(VR)原型、一种使用控制器的简单VR原型和一个标准的PC应用程序。标准化问卷的结果显示,在可用性方面,所有应用类型之间没有显著差异,在临场感方面,两种VR应用之间也没有显著差异。参与者同意以下观点:VR可视化提供了更好的深度信息,使用手而不是控制器简化了数据探索,多感官VR原型允许直观的数据探索,并且它比传统的数据检查方法更有益。虽然大多数参与者提到手动交互是最好的方面,但他们也发现这是最需要改进的方面。我们得出结论,具有改进的手动交互的多感官XR应用为容积生物医学数据检查增加了价值。我们将继续我们的开源研究项目ISH3DE(直观立体触觉3D数据探索),以服务于医学教育、治疗决策、手术准备或研究数据分析。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1dfb/11811323/ec77f0a5854f/10278_2024_1094_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1dfb/11811323/666787a1221e/10278_2024_1094_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1dfb/11811323/c05d4da32a97/10278_2024_1094_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1dfb/11811323/c7d19f8f44bc/10278_2024_1094_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1dfb/11811323/ec77f0a5854f/10278_2024_1094_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1dfb/11811323/666787a1221e/10278_2024_1094_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1dfb/11811323/c05d4da32a97/10278_2024_1094_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1dfb/11811323/c7d19f8f44bc/10278_2024_1094_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/1dfb/11811323/ec77f0a5854f/10278_2024_1094_Fig4_HTML.jpg

相似文献

[1]
Multisensory Extended Reality Applications Offer Benefits for Volumetric Biomedical Image Analysis in Research and Medicine.

J Imaging Inform Med. 2025-2

[2]
Virtual and augmented reality in biomedical engineering.

Biomed Eng Online. 2023-7-31

[3]
Do Multisensory Stimuli Benefit the Virtual Reality Experience? A Systematic Review.

IEEE Trans Vis Comput Graph. 2022-2

[4]
Exploring virtual reality object perception following sensory-motor interactions with different visuo-haptic collider properties.

Sci Rep. 2024-5-1

[5]
An Overview of Wearable Haptic Technologies and Their Performance in Virtual Object Exploration.

Sensors (Basel). 2023-2-1

[6]
Virtual and augmented reality for biomedical applications.

Cell Rep Med. 2021-7-20

[7]
Virtual reality for 3D histology: multi-scale visualization of organs with interactive feature exploration.

BMC Cancer. 2021-10-22

[8]
Creating 3D models from Radiologic Images for Virtual Reality Medical Education Modules.

J Med Syst. 2019-5-3

[9]
Nextmed: Automatic Imaging Segmentation, 3D Reconstruction, and 3D Model Visualization Platform Using Augmented and Virtual Reality.

Sensors (Basel). 2020-5-23

[10]
Extended reality to assess post-stroke manual dexterity: contrasts between the classic box and block test, immersive virtual reality with controllers, with hand-tracking, and mixed-reality tests.

J Neuroeng Rehabil. 2024-3-15

引用本文的文献

[1]
Answer to the Letter to the Editor from Hinpetch Daungsupawong Concerning "Development of New Surgical Training for Full Endoscopic Surgery Using 3D-Printed Models".

Spine Surg Relat Res. 2025-2-7

[2]
Application of extended reality in pediatric neurosurgery: A comprehensive review.

Biomed J. 2024-12-8

本文引用的文献

[1]
- a large-scale dataset of 3D medical shapes for computer vision.

Biomed Tech (Berl). 2024-12-30

[2]
TotalSegmentator: Robust Segmentation of 104 Anatomic Structures in CT Images.

Radiol Artif Intell. 2023-7-5

[3]
Use of Mixed Reality in Neuro-Oncology: A Single Centre Experience.

Life (Basel). 2023-1-31

[4]
The human splenic microcirculation is entirely open as shown by 3D models in virtual reality.

Sci Rep. 2022-10-1

[5]
Magnetic resonance cholangiopancreatography enhanced by virtual reality as a novel tool to improve the understanding of biliary anatomy and the teaching of surgical trainees.

Front Surg. 2022-8-12

[6]
Force quantification and simulation of pedicle screw tract palpation using direct visuo-haptic volume rendering.

Int J Comput Assist Radiol Surg. 2020-11

[7]
Toward Whole-Hand Kinesthetic Feedback: A Survey of Force Feedback Gloves.

IEEE Trans Haptics. 2018-11-19

[8]
Hydrogels for Engineering of Perfusable Vascular Networks.

Int J Mol Sci. 2015-7-14

[9]
Optimal integration of shape information from vision and touch.

Exp Brain Res. 2007-6

[10]
From presence to consciousness through virtual reality.

Nat Rev Neurosci. 2005-4

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

推荐工具

医学文档翻译智能文献检索