Gasmi Karim, Ayadi Hajer, Torjmen Mouna
Department of Computer Science, College of Computer and Information Sciences, Jouf University, Sakaka 72388, Saudi Arabia.
Information Retrieval and Knowledge Management Research Laboratory, York University, Toronto, ON M3J 1P3, Canada.
Diagnostics (Basel). 2024 Jun 6;14(11):1204. doi: 10.3390/diagnostics14111204.
In recent years, Convolutional Neural Network (CNN) models have demonstrated notable advancements in various domains such as image classification and Natural Language Processing (NLP). Despite their success in image classification tasks, their potential impact on medical image retrieval, particularly in text-based medical image retrieval (TBMIR) tasks, has not yet been fully realized. This could be attributed to the complexity of the ranking process, as there is ambiguity in treating TBMIR as an image retrieval task rather than a traditional information retrieval or NLP task. To address this gap, our paper proposes a novel approach to re-ranking medical images using a Deep Matching Model (DMM) and Medical-Dependent Features (MDF). These features incorporate categorical attributes such as medical terminologies and imaging modalities. Specifically, our DMM aims to generate effective representations for query and image metadata using a personalized CNN, facilitating matching between these representations. By using MDF, a semantic similarity matrix based on Unified Medical Language System (UMLS) meta-thesaurus, and a set of personalized filters taking into account some ranking features, our deep matching model can effectively consider the TBMIR task as an image retrieval task, as previously mentioned. To evaluate our approach, we performed experiments on the medical ImageCLEF datasets from 2009 to 2012. The experimental results show that the proposed model significantly enhances image retrieval performance compared to the baseline and state-of-the-art approaches.
近年来,卷积神经网络(CNN)模型在图像分类和自然语言处理(NLP)等各个领域都取得了显著进展。尽管它们在图像分类任务中取得了成功,但其对医学图像检索的潜在影响,特别是在基于文本的医学图像检索(TBMIR)任务中的影响,尚未得到充分实现。这可能归因于排序过程的复杂性,因为将TBMIR视为图像检索任务而非传统信息检索或NLP任务存在模糊性。为了弥补这一差距,我们的论文提出了一种使用深度匹配模型(DMM)和医学相关特征(MDF)对医学图像进行重新排序的新方法。这些特征包含医学术语和成像模态等分类属性。具体而言,我们的DMM旨在使用个性化的CNN为查询和图像元数据生成有效的表示,促进这些表示之间的匹配。通过使用基于统一医学语言系统(UMLS)元叙词表的语义相似性矩阵以及考虑一些排序特征的一组个性化过滤器,我们的深度匹配模型可以如前所述有效地将TBMIR任务视为图像检索任务。为了评估我们的方法,我们对2009年至2012年的医学ImageCLEF数据集进行了实验。实验结果表明,与基线方法和现有技术方法相比,所提出的模型显著提高了图像检索性能。