Suppr超能文献

基于多阶段深度学习网络的蒙古图案细粒度修复

Fine-grained restoration of Mongolian patterns based on a multi-stage deep learning network.

作者信息

Zhang Lingna, Chen Junjie

机构信息

College of Computer and Information Engineering, Inner Mongolia Agricultural University, Huhhot, 010000, Inner Mongolia, China.

出版信息

Sci Rep. 2024 Dec 28;14(1):30963. doi: 10.1038/s41598-024-82097-0.

Abstract

Mongolian patterns are easily damaged by various factors in the process of inheritance and preservation, and the traditional manual restoration methods are time-consuming, laborious, and costly. With the development of deep learning technology and the rapid growth of the image restoration field, the existing image restoration methods are mostly aimed at natural scene images. They do not apply to Mongolian patterns with complex line texture structures and high saturation-rich colors. In order to solve this problem, this paper proposes a Mongolian pattern restoration model with a multi-stage network. In the first stage, a pyramid context encoder network is introduced to learn the contextual features of the image for global restoration; in the second stage, a local restoration network is constructed by combining the RIC convolutional layer and the MPD down-sampling module; and in the third stage, the global refinement restoration is carried out by using the U-Net network that incorporates the attention mechanism. The experimental results show that this paper's method achieves remarkable results in the Mongolian pattern repair task, using four evaluation metrics such as Peak Signal-to-Noise Ratio (PSNR), Structural Similarity (SSIM), LPIPS, and L1 Loss to compare with the existing method. The results show that this paper's method performs well in the Mongolian pattern repair task. Also, the performance of the model on public datasets verifies its wide applicability. The method in this paper provides an efficient solution for the digital restoration of Mongolian motifs and has important application prospects.

摘要

蒙古图案在传承和保存过程中容易受到各种因素的破坏,传统的手工修复方法耗时、费力且成本高。随着深度学习技术的发展和图像修复领域的快速增长,现有的图像修复方法大多针对自然场景图像。它们不适用于具有复杂线条纹理结构和高饱和度丰富色彩的蒙古图案。为了解决这个问题,本文提出了一种具有多阶段网络的蒙古图案修复模型。在第一阶段,引入金字塔上下文编码器网络来学习图像的上下文特征以进行全局修复;在第二阶段,通过结合RIC卷积层和MPD下采样模块构建局部修复网络;在第三阶段,使用包含注意力机制的U-Net网络进行全局细化修复。实验结果表明,本文的方法在蒙古图案修复任务中取得了显著成果,使用峰值信噪比(PSNR)、结构相似性(SSIM)、LPIPS和L1损失等四个评估指标与现有方法进行比较。结果表明,本文的方法在蒙古图案修复任务中表现良好。此外,该模型在公共数据集上的性能验证了其广泛的适用性。本文的方法为蒙古图案的数字修复提供了一种有效的解决方案,具有重要的应用前景。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/a0e6/11680848/aac4a7f63454/41598_2024_82097_Fig1_HTML.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验