Suppr超能文献

深度学习算法在视觉通信课程中的应用。

Application of Deep Learning Algorithms to Visual Communication Courses.

作者信息

Wang Zewen, Li Jiayi, Wu Jieting, Xu Hui

机构信息

Pan Tianshou College of Architecture, Art and Design, Ningbo University, Ningbo, China.

Department of Control and Computer Engineering, Polytechnic University of Turin, Turin, Italy.

出版信息

Front Psychol. 2021 Sep 29;12:713723. doi: 10.3389/fpsyg.2021.713723. eCollection 2021.

Abstract

There are rare studies on the combination of visual communication courses and image style transfer. Nevertheless, such a combination can make students understand the difference in perception brought by image styles more vividly. Therefore, a collaborative application is reported here combining visual communication courses and image style transfer. First, the visual communication courses are sorted out to obtain the relationship between them and image style transfer. Then, a style transfer method based on deep learning is designed, and a fast transfer network is introduced. Moreover, the image rendering is accelerated by separating training and execution. Besides, a fast style conversion network is constructed based on TensorFlow, and a style model is obtained after training. Finally, six types of images are selected from the Google Gallery for the conversion of image style, including landscape images, architectural images, character images, animal images, cartoon images, and hand-painted images. The style transfer method achieves excellent effects on the whole image besides the part hard to be rendered. Furthermore, the increase in iterations of the image style transfer network alleviates lack of image content and image style. The image style transfer method reported here can quickly transmit image style in less than 1 s and realize real-time image style transmission. Besides, this method effectively improves the stylization effect and image quality during the image style conversion. The proposed style transfer system can increase students' understanding of different artistic styles in visual communication courses, thereby improving the learning efficiency of students.

摘要

关于视觉传达课程与图像风格迁移相结合的研究很少。然而,这样的结合可以让学生更生动地理解图像风格所带来的感知差异。因此,本文报道了一种将视觉传达课程与图像风格迁移相结合的协同应用。首先,梳理视觉传达课程,以获得它们与图像风格迁移之间的关系。然后,设计一种基于深度学习的风格迁移方法,并引入一个快速迁移网络。此外,通过分离训练和执行来加速图像渲染。此外,基于TensorFlow构建一个快速风格转换网络,训练后得到一个风格模型。最后,从谷歌图库中选取六种类型的图像进行图像风格转换,包括风景图像、建筑图像、人物图像、动物图像、卡通图像和手绘图像。除了难以渲染的部分外,该风格迁移方法在整个图像上都取得了优异的效果。此外,图像风格迁移网络迭代次数的增加缓解了图像内容和图像风格的不足。本文报道的图像风格迁移方法可以在不到1秒的时间内快速传递图像风格,实现实时图像风格传输。此外,该方法有效地提高了图像风格转换过程中的风格化效果和图像质量。所提出的风格迁移系统可以增加学生在视觉传达课程中对不同艺术风格的理解,从而提高学生的学习效率。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/57dd/8514077/7f0886aa9d6e/fpsyg-12-713723-g001.jpg

相似文献

1
Application of Deep Learning Algorithms to Visual Communication Courses.
Front Psychol. 2021 Sep 29;12:713723. doi: 10.3389/fpsyg.2021.713723. eCollection 2021.
2
UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene.
IEEE Trans Vis Comput Graph. 2025 Apr;31(4):2045-2057. doi: 10.1109/TVCG.2024.3378692. Epub 2025 Feb 27.
3
Automatic Color Sketch Generation Using Deep Style Transfer.
IEEE Comput Graph Appl. 2019 Mar-Apr;39(2):26-37. doi: 10.1109/MCG.2019.2899089. Epub 2019 Feb 12.
4
CSAST: Content self-supervised and style contrastive learning for arbitrary style transfer.
Neural Netw. 2023 Jul;164:146-155. doi: 10.1016/j.neunet.2023.04.037. Epub 2023 Apr 26.
5
Cartoon-Style Image Rendering Transfer Based on Neural Networks.
Comput Intell Neurosci. 2022 Jul 16;2022:2958338. doi: 10.1155/2022/2958338. eCollection 2022.
6
Neural Network-Based Mapping Mining of Image Style Transfer in Big Data Systems.
Comput Intell Neurosci. 2021 Aug 21;2021:8387382. doi: 10.1155/2021/8387382. eCollection 2021.
7
Digital Image Art Style Transfer Algorithm Based on CycleGAN.
Comput Intell Neurosci. 2022 Jan 13;2022:6075398. doi: 10.1155/2022/6075398. eCollection 2022.
8
CAPTCHA Image Generation: Two-Step Style-Transfer Learning in Deep Neural Networks.
Sensors (Basel). 2020 Mar 9;20(5):1495. doi: 10.3390/s20051495.
9
KBStyle: Fast Style Transfer Using a 200 KB Network With Symmetric Knowledge Distillation.
IEEE Trans Image Process. 2024;33:82-94. doi: 10.1109/TIP.2023.3335828. Epub 2023 Dec 8.
10
Deep Learning for Breast MRI Style Transfer with Limited Training Data.
J Digit Imaging. 2023 Apr;36(2):666-678. doi: 10.1007/s10278-022-00755-z. Epub 2022 Dec 21.

本文引用的文献

1
2
Breast Cancer Histopathology Image Classification Using an Ensemble of Deep Learning Models.
Sensors (Basel). 2020 Aug 5;20(16):4373. doi: 10.3390/s20164373.
3
Using a Teaching Intervention and Calibrated Peer Review™ Diagnostics to Improve Visual Communication Skills.
Ann Biomed Eng. 2018 Mar;46(3):513-524. doi: 10.1007/s10439-017-1946-x. Epub 2017 Nov 3.
4
Transcranial Direct Current Stimulation Facilitates Associative Learning and Alters Functional Connectivity in the Primate Brain.
Curr Biol. 2017 Oct 23;27(20):3086-3096.e3. doi: 10.1016/j.cub.2017.09.020. Epub 2017 Oct 12.
5
Widespread neural oscillations in the delta band dissociate rule convergence from rule divergence during creative idea generation.
Neuropsychologia. 2017 Sep;104:8-17. doi: 10.1016/j.neuropsychologia.2017.07.033. Epub 2017 Jul 31.
7
Regulating approaches to learning: Testing learning strategy convergences across a year at university.
Br J Educ Psychol. 2018 Mar;88(1):21-41. doi: 10.1111/bjep.12169. Epub 2017 Jul 10.
8
Convolution Neural Networks With Two Pathways for Image Style Recognition.
IEEE Trans Image Process. 2017 Sep;26(9):4102-4113. doi: 10.1109/TIP.2017.2710631. Epub 2017 Jun 9.
9
Conservation implications of anthropogenic impacts on visual communication and camouflage.
Conserv Biol. 2017 Feb;31(1):30-39. doi: 10.1111/cobi.12834. Epub 2016 Dec 14.
10
Compressive Sampling-Based Image Coding for Resource-Deficient Visual Communication.
IEEE Trans Image Process. 2016 Jun;25(6):2844-2855. doi: 10.1109/TIP.2016.2554320. Epub 2016 Apr 14.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验