Knowledge Engineering Research Group, Technical University of Cluj-Napoca, Cluj-Napoca 400027, Romania.
Int J Neural Syst. 2023 Jul;33(7):2350040. doi: 10.1142/S0129065723500405. Epub 2023 Jun 17.
Meaning Representation parsing aims to represent a sentence as a structured, Directed, Acyclic Graph (DAG), in an attempt to extract meaning from text. This paper extends an existing 2-stage pipeline AMR parser with state-of-the-art techniques in dependency parsing. First, Pointer-Generator Networks are used for out-of-vocabulary words in the concept identification stage, with an improved initialization via the use of word-and character-level embeddings. Second, the performance of the Relation Identification module is improved by jointly training the Heads Selection and the Arcs Labeling components. Last, we underline the difficulty of end-to-end training with recurrent modules in a static deep neural network construction approach and explore a dynamic construction implementation, which continuously adapts the computation graph, thus potentially enabling end-to-end training in the proposed pipeline solution.
意义表示解析旨在将句子表示为一个结构化的、有向的无环图(DAG),以尝试从文本中提取意义。本文在现有的两阶段 AMR 解析器中扩展了最先进的依存解析技术。首先,在概念识别阶段使用指针生成网络来处理词汇表外的单词,并通过使用单词和字符级别的嵌入来改进初始化。其次,通过联合训练 Heads Selection 和 Arcs Labeling 组件来提高关系识别模块的性能。最后,我们强调了在静态深度神经网络构建方法中使用递归模块进行端到端训练的困难,并探索了一种动态构建实现,该实现可以不断调整计算图,从而有可能在提出的管道解决方案中实现端到端训练。