Wu Gangao, Jin Enhui, Sun Yanling, Tang Bixia, Zhao Wenming
National Genomics Data Center, China National Center for Bioinformation, Beijing 100101, China.
Beijing Institute of Genomics, Chinese Academy of Sciences, Beijing 100101, China.
Bioengineering (Basel). 2024 Jul 2;11(7):673. doi: 10.3390/bioengineering11070673.
In medical image retrieval, accurately retrieving relevant images significantly impacts clinical decision making and diagnostics. Traditional image-retrieval systems primarily rely on single-dimensional image data, while current deep-hashing methods are capable of learning complex feature representations. However, retrieval accuracy and efficiency are hindered by diverse modalities and limited sample sizes.
To address this, we propose a novel deep learning-based hashing model, the Deep Attention Fusion Hashing (DAFH) model, which integrates advanced attention mechanisms with medical imaging data.
The DAFH model enhances retrieval performance by integrating multi-modality medical imaging data and employing attention mechanisms to optimize the feature extraction process. Utilizing multimodal medical image data from the Cancer Imaging Archive (TCIA), this study constructed and trained a deep hashing network that achieves high-precision classification of various cancer types.
At hash code lengths of 16, 32, and 48 bits, the model respectively attained Mean Average Precision (MAP@10) values of 0.711, 0.754, and 0.762, highlighting the potential and advantage of the DAFH model in medical image retrieval.
The DAFH model demonstrates significant improvements in the efficiency and accuracy of medical image retrieval, proving to be a valuable tool in clinical settings.
在医学图像检索中,准确检索相关图像对临床决策和诊断有重大影响。传统的图像检索系统主要依赖单维图像数据,而当前的深度哈希方法能够学习复杂的特征表示。然而,多样的模态和有限的样本量阻碍了检索的准确性和效率。
为解决这一问题,我们提出了一种基于深度学习的新型哈希模型,即深度注意力融合哈希(DAFH)模型,该模型将先进的注意力机制与医学成像数据相结合。
DAFH模型通过整合多模态医学成像数据并采用注意力机制优化特征提取过程来提高检索性能。本研究利用来自癌症成像存档(TCIA)的多模态医学图像数据,构建并训练了一个深度哈希网络,该网络可实现对各种癌症类型的高精度分类。
在哈希码长度为16位、32位和48位时,该模型的平均精度均值(MAP@10)分别达到0.711、0.754和0.762,突出了DAFH模型在医学图像检索中的潜力和优势。
DAFH模型在医学图像检索的效率和准确性方面有显著提高,证明是临床环境中的一个有价值的工具。