Department of Applied Mechanics, Indian Institute of Technology Delhi, Hauz Khas, Delhi, 110016, India.
Department of Applied Mechanics, Indian Institute of Technology Delhi, Hauz Khas, Delhi, 110016, India; Yardi School of Artificial Intelligence (ScAI), Indian Institute of Technology Delhi, Hauz Khas, Delhi, 110016, India.
Comput Methods Programs Biomed. 2023 Apr;232:107436. doi: 10.1016/j.cmpb.2023.107436. Epub 2023 Feb 24.
The application of intelligent imaging techniques and deep learning in the field of computer-aided diagnosis and medical imaging have improved and accelerated the early diagnosis of many diseases. Elastography is an imaging modality where an inverse problem is solved to extract the elastic properties of tissues and subsequently mapped to anatomical images for diagnostic purposes. In the present work, we propose a wavelet neural operator-based approach for correctly learning the non-linear mapping of elastic properties directly from measured displacement field data.
The proposed framework learns the underlying operator behind the elastic mapping and thus can map any displacement data from a family to the elastic properties. The displacement fields are first uplifted to a high-dimensional space using a fully connected neural network. On the lifted data, certain iterations are performed using wavelet neural blocks. In each wavelet neural block, the lifted data are decomposed into low, and high-frequency components using wavelet decomposition. To learn the most relevant patterns and structural information from the input, the neural network kernels are directly convoluted with the outputs of the wavelet decomposition. Thereafter the elasticity field is reconstructed from the outputs from convolution. The mapping between the displacement and the elasticity using wavelets is unique and remains stable during training.
The proposed framework is tested on several artificially fabricated numerical examples, including a benign-cum-malignant tumor prediction problem. The trained model was also tested on real Ultrasound-based elastography data to demonstrate the applicability of the proposed scheme in clinical usage. The proposed framework reproduces the highly accurate elasticity field directly from the displacement inputs.
The proposed framework circumvents different data pre-processing and intermediate steps utilized in traditional methods, hence providing an accurate elasticity map. The computationally efficient framework requires fewer epochs for training, which bodes well for its clinical usability for real-time predictions. The weights and biases from pre-trained models can also be employed for transfer learning, which reduces the effective training time with random initialization.
智能成像技术和深度学习在计算机辅助诊断和医学成像领域的应用,提高和加速了许多疾病的早期诊断。弹性成像是一种通过求解反问题来提取组织弹性特性并随后映射到解剖图像以进行诊断的成像方式。在本工作中,我们提出了一种基于小波神经网络算子的方法,用于正确地从测量的位移场数据中直接学习弹性特性的非线性映射。
所提出的框架学习弹性映射背后的基本算子,从而可以将任何来自一族的位移数据映射到弹性特性。位移场首先使用全连接神经网络提升到高维空间。在提升的数据上,使用小波神经网络块执行若干迭代。在每个小波神经网络块中,使用小波分解将提升的数据分解为低和高频分量。为了从输入中学习最相关的模式和结构信息,神经网络核直接与小波分解的输出卷积。从卷积的输出中重建弹性场。使用小波的位移和弹性之间的映射是唯一的,并且在训练过程中保持稳定。
在所提出的框架上测试了几个人为制造的数值示例,包括良性-恶性肿瘤预测问题。还在真实的基于超声的弹性成像数据上测试了训练后的模型,以证明所提出方案在临床应用中的适用性。所提出的框架直接从位移输入中再现高度准确的弹性场。
所提出的框架避开了传统方法中使用的不同数据预处理和中间步骤,因此提供了准确的弹性图。计算效率高的框架需要较少的训练轮次,这对于其在实时预测方面的临床可用性非常有利。还可以使用预训练模型的权重和偏差进行迁移学习,这可以减少随机初始化的有效训练时间。