Kim Chung-Il, Kim Meejoung, Jung Seungwon, Hwang Eenjun
School of Electrical Engineering, Korea University, Seoul 02841, Korea.
Research Institute for Information and Communication Technology, Korea University, Seoul 02841, Korea.
Sensors (Basel). 2020 Mar 11;20(6):1548. doi: 10.3390/s20061548.
We introduce a distance metric between two distributions and propose a Generative Adversarial Network (GAN) model: the Simplified Fréchet distance (SFD) and the Simplified Fréchet GAN (SFGAN). Although the data generated through GANs are similar to real data, GAN often undergoes unstable training due to its adversarial structure. A possible solution to this problem is considering Fréchet distance (FD). However, FD is unfeasible to realize due to its covariance term. SFD overcomes the complexity so that it enables us to realize in networks. The structure of SFGAN is based on the Boundary Equilibrium GAN (BEGAN) while using SFD in loss functions. Experiments are conducted with several datasets, including CelebA and CIFAR-10. The losses and generated samples of SFGAN and BEGAN are compared with several distance metrics. The evidence of mode collapse and/or mode drop does not occur until 3000k steps for SFGAN, while it occurs between 457k and 968k steps for BEGAN. Experimental results show that SFD makes GANs more stable than other distance metrics used in GANs, and SFD compensates for the weakness of models based on BEGAN-based network structure. Based on the experimental results, we can conclude that SFD is more suitable for GAN than other metrics.
我们引入了两种分布之间的距离度量,并提出了一种生成对抗网络(GAN)模型:简化弗雷歇距离(SFD)和简化弗雷歇GAN(SFGAN)。尽管通过GAN生成的数据与真实数据相似,但由于其对抗结构,GAN的训练往往不稳定。解决这个问题的一个可能方法是考虑弗雷歇距离(FD)。然而,由于其协方差项,FD难以实现。SFD克服了这种复杂性,使其能够在网络中实现。SFGAN的结构基于边界平衡GAN(BEGAN),同时在损失函数中使用SFD。我们使用包括CelebA和CIFAR-10在内的多个数据集进行了实验。将SFGAN和BEGAN的损失及生成的样本与几种距离度量进行了比较。对于SFGAN,直到3000k步才出现模式崩溃和/或模式下降的迹象,而对于BEGAN,在457k到968k步之间就出现了。实验结果表明,SFD使GAN比GAN中使用的其他距离度量更稳定,并且SFD弥补了基于BEGAN网络结构的模型的弱点。基于实验结果,我们可以得出结论,SFD比其他度量更适合GAN。