School of Software Engineering, Xi'an Jiaotong University, Xi'an 710049, China.
Sensors (Basel). 2020 Sep 14;20(18):5232. doi: 10.3390/s20185232.
Image neural style transfer is a process of utilizing convolutional neural networks to render a content image based on a style image. The algorithm can compute a stylized image with original content from the given content image but a new style from the given style image. Style transfer has become a hot topic both in academic literature and industrial applications. The stylized results of current existing models are not ideal because of the color difference between two input images and the inconspicuous details of content image. To solve the problems, we propose two style transfer models based on robust nonparametric distribution transfer. The first model converts the color probability density function of the content image into that of the style image before style transfer. When the color dynamic range of the content image is smaller than that of style image, this model renders more reasonable spatial structure than the existing models. Then, an adaptive detail-enhanced exposure correction algorithm is proposed for underexposed images. Based this, the second model is proposed for the style transfer of underexposed content images. It can further improve the stylized results of underexposed images. Compared with popular methods, the proposed methods achieve the satisfactory qualitative and quantitative results.
图像神经风格迁移是利用卷积神经网络根据风格图像生成内容图像的过程。该算法可以从给定的内容图像中计算出具有原始内容的风格化图像,而从给定的风格图像中计算出具有新风格的图像。风格迁移在学术文献和工业应用中都是一个热门话题。由于两幅输入图像之间的颜色差异和内容图像中不明显的细节,当前现有模型的风格化结果并不理想。为了解决这些问题,我们提出了两种基于鲁棒非参数分布迁移的风格迁移模型。第一个模型在进行风格迁移之前,将内容图像的颜色概率密度函数转换为风格图像的颜色概率密度函数。当内容图像的颜色动态范围小于风格图像时,该模型比现有模型渲染出更合理的空间结构。然后,提出了一种针对欠曝光图像的自适应细节增强曝光校正算法。在此基础上,提出了第二个模型用于欠曝光内容图像的风格迁移。它可以进一步提高欠曝光图像的风格化效果。与流行的方法相比,所提出的方法在定性和定量方面都取得了令人满意的结果。