• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

一种基于动态决策生成网络和生成对抗网络的新型图像语义通信方法。

A novel image semantic communication method via dynamic decision generation network and generative adversarial network.

作者信息

Liu Shugang, Peng Zhan, Yu Qiangguo, Duan Linan

机构信息

School of Physics and Electronic Science, Hunan University of Science and Technology, Xiangtan, 411201, China.

Key Laboratory of Intelligent Sensors and Advanced Sensing Materials of Hunan Province, Hunan University of Science and Technology, Xiangtan, 411201, China.

出版信息

Sci Rep. 2024 Aug 23;14(1):19636. doi: 10.1038/s41598-024-70619-9.

DOI:10.1038/s41598-024-70619-9
PMID:39179724
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11344051/
Abstract

Effectively compressing transmitted images and reducing the distortion of reconstructed images are challenges in image semantic communication. This paper proposes a novel image semantic communication model that integrates a dynamic decision generation network and a generative adversarial network to address these challenges as efficiently as possible. At the transmitter, features are extracted and selected based on the channel's signal-to-noise ratio (SNR) using semantic encoding and a dynamic decision generation network. This semantic approach can effectively compress transmitted images, thereby reducing communication traffic. At the receiver, the generator/decoder collaborates with the discriminator network, enhancing image reconstruction quality through adversarial and perceptual losses. The experimental results on the CIFAR-10 dataset demonstrate that our scheme achieves a peak SNR of 26 dB, a structural similarity of 0.9, and a compression ratio (CR) of 81.5% in an AWGN channel with an SNR of 3 dB. Similarly, in the Rayleigh fading channel, the peak SNR is 23 dB, structural similarity is 0.8, and the CR is 80.5%. The learned perceptual image patch similarity in both channels is below 0.008. These experiments thoroughly demonstrate that the proposed semantic communication is a superior deep learning-based joint source-channel coding method, offering a high CR and low distortion of reconstructed images.

摘要

有效地压缩传输图像并减少重建图像的失真,是图像语义通信中的挑战。本文提出了一种新颖的图像语义通信模型,该模型集成了动态决策生成网络和生成对抗网络,以尽可能高效地应对这些挑战。在发射端,使用语义编码和动态决策生成网络,基于信道的信噪比(SNR)提取并选择特征。这种语义方法可以有效地压缩传输图像,从而减少通信流量。在接收端,生成器/解码器与判别器网络协作,通过对抗损失和感知损失提高图像重建质量。在CIFAR-10数据集上的实验结果表明,在信噪比为3 dB的加性高斯白噪声(AWGN)信道中,我们的方案实现了26 dB的峰值信噪比、0.9的结构相似性和81.5%的压缩率(CR)。同样,在瑞利衰落信道中,峰值信噪比为23 dB,结构相似性为0.8,压缩率为80.5%。在两个信道中学习到的感知图像块相似性均低于0.008。这些实验充分证明,所提出的语义通信是一种基于深度学习的优越的联合信源信道编码方法,具有高压缩率和低重建图像失真。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/725cf3df3458/41598_2024_70619_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/1ed5b5205322/41598_2024_70619_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/9b90190cd1f0/41598_2024_70619_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/3765691222da/41598_2024_70619_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/e8587337d183/41598_2024_70619_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/46ae0e0202e8/41598_2024_70619_Figa_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/9a94118a348a/41598_2024_70619_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/725cf3df3458/41598_2024_70619_Fig6_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/1ed5b5205322/41598_2024_70619_Fig1_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/9b90190cd1f0/41598_2024_70619_Fig2_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/3765691222da/41598_2024_70619_Fig3_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/e8587337d183/41598_2024_70619_Fig4_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/46ae0e0202e8/41598_2024_70619_Figa_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/9a94118a348a/41598_2024_70619_Fig5_HTML.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5fad/11344051/725cf3df3458/41598_2024_70619_Fig6_HTML.jpg

相似文献

1
A novel image semantic communication method via dynamic decision generation network and generative adversarial network.一种基于动态决策生成网络和生成对抗网络的新型图像语义通信方法。
Sci Rep. 2024 Aug 23;14(1):19636. doi: 10.1038/s41598-024-70619-9.
2
Brain tumor classification for MRI images using dual-discriminator conditional generative adversarial network.基于双鉴别器条件生成对抗网络的 MRI 图像脑肿瘤分类。
Electromagn Biol Med. 2024 Apr 2;43(1-2):81-94. doi: 10.1080/15368378.2024.2321352. Epub 2024 Mar 10.
3
Ultra-low-dose PET reconstruction using generative adversarial network with feature matching and task-specific perceptual loss.基于特征匹配和任务特定感知损失的生成对抗网络的超低剂量 PET 重建。
Med Phys. 2019 Aug;46(8):3555-3564. doi: 10.1002/mp.13626. Epub 2019 Jun 17.
4
NG-GAN: A Robust Noise-Generation Generative Adversarial Network for Generating Old-Image Noise.NG-GAN:一种用于生成旧图像噪声的强大噪声生成生成对抗网络。
Sensors (Basel). 2022 Dec 26;23(1):251. doi: 10.3390/s23010251.
5
A Novel Adversarial Deep Learning Method for Substation Defect Image Generation.一种用于变电站缺陷图像生成的新型对抗深度学习方法。
Sensors (Basel). 2024 Jul 12;24(14):4512. doi: 10.3390/s24144512.
6
Low-light image enhancement using generative adversarial networks.使用生成对抗网络的低光照图像增强
Sci Rep. 2024 Aug 9;14(1):18489. doi: 10.1038/s41598-024-69505-1.
7
A Generative Adversarial Network for Infrared and Visible Image Fusion Based on Semantic Segmentation.基于语义分割的红外与可见光图像融合生成对抗网络
Entropy (Basel). 2021 Mar 21;23(3):376. doi: 10.3390/e23030376.
8
A medical image classification method based on self-regularized adversarial learning.基于自正则化对抗学习的医学图像分类方法。
Med Phys. 2024 Nov;51(11):8232-8246. doi: 10.1002/mp.17320. Epub 2024 Jul 30.
9
Unsupervised arterial spin labeling image superresolution via multiscale generative adversarial network.基于多尺度生成对抗网络的无监督动脉自旋标记图像超分辨率。
Med Phys. 2022 Apr;49(4):2373-2385. doi: 10.1002/mp.15468. Epub 2022 Mar 7.
10
Generating synthesized computed tomography from CBCT using a conditional generative adversarial network for head and neck cancer patients.利用条件生成对抗网络从 CBCT 生成头颈部癌症患者的合成 CT。
Technol Cancer Res Treat. 2022 Jan-Dec;21:15330338221085358. doi: 10.1177/15330338221085358.

本文引用的文献

1
A generative adversarial network for synthetization of regions of interest based on digital mammograms.基于数字乳腺 X 线摄影的感兴趣区域生成对抗网络合成
Sci Rep. 2022 Apr 13;12(1):6166. doi: 10.1038/s41598-022-09929-9.
2
Task-Driven Semantic Coding via Reinforcement Learning.任务驱动的语义编码通过强化学习。
IEEE Trans Image Process. 2021;30:6307-6320. doi: 10.1109/TIP.2021.3091909. Epub 2021 Jul 13.
3
Semantic Perceptual Image Compression With a Laplacian Pyramid of Convolutional Networks.基于卷积网络拉普拉斯金字塔的语义感知图像压缩
IEEE Trans Image Process. 2021;30:4225-4237. doi: 10.1109/TIP.2021.3065244. Epub 2021 Apr 12.
4
FCSS: Fully Convolutional Self-Similarity for Dense Semantic Correspondence.FCSS:用于密集语义对应关系的全卷积自相似性
IEEE Trans Pattern Anal Mach Intell. 2019 Mar;41(3):581-595. doi: 10.1109/TPAMI.2018.2803169. Epub 2018 Feb 7.