Uduagbomen Joshua, Leeson Mark S, Liu Zheng, Lakshminarayana Subhash, Xu Tianhua
Appl Opt. 2024 May 10;63(14):3794-3802. doi: 10.1364/AO.524426.
Physics-informed neural networks (PINNs) have recently emerged as an important and ground-breaking technique in scientific machine learning for numerous applications including in optical fiber communications. However, the vanilla/baseline version of PINNs is prone to fail under certain conditions because of the nature of the physics-based regularization term in its loss function. The use of this unique regularization technique results in a highly complex non-convex loss landscape when visualized. This leads to failure modes in PINN-based modeling. The baseline PINN works very well as an optical fiber model with relatively simple fiber parameters and for uncomplicated transmission tasks. Yet, it struggles when the modeling task becomes relatively complex, reaching very high error, for example, numerous modeling tasks/scenarios in soliton communication and soliton pulse development in special fibers such as erbium-doped dispersion compensating fibers. We implement two methods to circumvent the limitations caused by the physics-based regularization term to solve this problem, namely, the so-called scaffolding technique for PINN modeling and the progressive block learning PINN modeling strategy to solve the nonlinear Schrödinger equation (NLSE), which models pulse propagation in an optical fiber. This helps PINN learn more accurately the dynamics of pulse evolution and increases accuracy by two to three orders of magnitude. We show in addition that this error is not due to the depth or architecture of the neural network but a fundamental issue inherent to PINN by design. The results achieved indicate a considerable reduction in PINN error for complex modeling problems, with accuracy increasing by up to two orders of magnitude.
物理信息神经网络(PINNs)最近已成为科学机器学习中一项重要且具有开创性的技术,可用于包括光纤通信在内的众多应用。然而,PINNs的原始/基线版本由于其损失函数中基于物理的正则化项的性质,在某些条件下容易失败。当可视化时,这种独特正则化技术的使用会导致高度复杂的非凸损失景观。这导致基于PINN的建模出现失败模式。基线PINN作为具有相对简单光纤参数的光纤模型以及用于简单的传输任务时工作得非常好。然而,当建模任务变得相对复杂时,它就会遇到困难,例如在孤子通信中的众多建模任务/场景以及在诸如掺铒色散补偿光纤等特殊光纤中的孤子脉冲发展中,会达到非常高的误差。我们实施了两种方法来规避由基于物理的正则化项引起的限制以解决此问题,即所谓的用于PINN建模的脚手架技术和用于求解非线性薛定谔方程(NLSE)的渐进块学习PINN建模策略,该方程对光纤中的脉冲传播进行建模。这有助于PINN更准确地学习脉冲演化的动力学,并将精度提高两到三个数量级。我们还表明,这种误差不是由于神经网络的深度或架构,而是PINN设计中固有的一个基本问题。所取得的结果表明,对于复杂建模问题,PINN误差有相当大的降低,精度提高了多达两个数量级。