• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

XTQA:教科书问答的跨度级解释

XTQA: Span-Level Explanations for Textbook Question Answering.

作者信息

Ma Jie, Chai Qi, Liu Jun, Yin Qingyu, Wang Pinghui, Zheng Qinghua

出版信息

IEEE Trans Neural Netw Learn Syst. 2024 Nov;35(11):16493-16503. doi: 10.1109/TNNLS.2023.3294991. Epub 2024 Oct 29.

DOI:10.1109/TNNLS.2023.3294991
PMID:37486840
Abstract

Textbook question answering (TQA) is the task of correctly answering diagram or nondiagram (ND) questions given large multimodal contexts consisting of abundant essays and diagrams. In real-world scenarios, an explainable TQA system plays a key role in deepening humans' understanding of learned knowledge. However, there is no work to investigate how to provide explanations currently. To address this issue, we devise a novel architecture toward span-level eXplanations for TQA (XTQA). In this article, spans are the combinations of sentences within a paragraph. The key idea is to consider the entire textual context of a lesson as candidate evidence and then use our proposed coarse-to-fine grained explanation extracting (EE) algorithm to narrow down the evidence scope and extract the span-level explanations with varying lengths for answering different questions. The EE algorithm can also be integrated into other TQA methods to make them explainable and improve the TQA performance. Experimental results show that XTQA obtains the best overall explanation result [mean intersection over union (mIoU)] of 52.38% on the first 300 questions of CK12-QA test splits, demonstrating the explainability of our method (ND: 150 and diagram: 150). The results also show that XTQA achieves the best TQA performance of 36.46% and 36.95% on the aforementioned splits. We have released our code in https://github.com/dr-majie/opentqa.

摘要

教科书问答(TQA)是指在由大量文章和图表组成的大型多模态语境下正确回答图表或非图表(ND)问题的任务。在现实场景中,一个可解释的TQA系统在加深人类对所学知识的理解方面起着关键作用。然而,目前尚无研究如何提供解释的工作。为了解决这个问题,我们设计了一种新颖的架构用于TQA的跨度级解释(XTQA)。在本文中,跨度是段落内句子的组合。关键思想是将课程的整个文本语境视为候选证据,然后使用我们提出的从粗到细粒度的解释提取(EE)算法来缩小证据范围,并提取不同长度的跨度级解释以回答不同问题。EE算法还可以集成到其他TQA方法中,使其具有可解释性并提高TQA性能。实验结果表明,XTQA在CK12 - QA测试拆分的前300个问题上获得了最佳的总体解释结果[平均交并比(mIoU)],为52.38%,证明了我们方法的可解释性(ND:150个问题,图表:150个问题)。结果还表明,XTQA在上述拆分上实现了最佳的TQA性能,分别为36.46%和36.95%。我们已将代码发布在https://github.com/dr-majie/opentqa 。

相似文献

1
XTQA: Span-Level Explanations for Textbook Question Answering.XTQA:教科书问答的跨度级解释
IEEE Trans Neural Netw Learn Syst. 2024 Nov;35(11):16493-16503. doi: 10.1109/TNNLS.2023.3294991. Epub 2024 Oct 29.
2
Weakly Supervised Learning for Textbook Question Answering.用于教科书问答的弱监督学习
IEEE Trans Image Process. 2022;31:7378-7388. doi: 10.1109/TIP.2022.3180563. Epub 2022 Dec 1.
3
Relation-Aware Fine-Grained Reasoning Network for Textbook Question Answering.用于教科书问答的关系感知细粒度推理网络
IEEE Trans Neural Netw Learn Syst. 2023 Jan;34(1):15-27. doi: 10.1109/TNNLS.2021.3089140. Epub 2023 Jan 5.
4
Relation-Aware Heterogeneous Graph Network for Learning Intermodal Semantics in Textbook Question Answering.用于教科书问答中学习跨模态语义的关系感知异构图网络
IEEE Trans Neural Netw Learn Syst. 2024 Sep;35(9):11872-11883. doi: 10.1109/TNNLS.2024.3385436. Epub 2024 Sep 3.
5
SemBioNLQA: A semantic biomedical question answering system for retrieving exact and ideal answers to natural language questions.SemBioNLQA:一个语义生物医学问答系统,用于检索自然语言问题的准确和理想答案。
Artif Intell Med. 2020 Jan;102:101767. doi: 10.1016/j.artmed.2019.101767. Epub 2019 Nov 28.
6
Knowledge-Augmented Visual Question Answering With Natural Language Explanation.
IEEE Trans Image Process. 2024;33:2652-2664. doi: 10.1109/TIP.2024.3379900. Epub 2024 Apr 3.
7
Efficient Machine Reading Comprehension for Health Care Applications: Algorithm Development and Validation of a Context Extraction Approach.用于医疗保健应用的高效机器阅读理解:上下文提取方法的算法开发与验证
JMIR Form Res. 2024 Mar 25;8:e52482. doi: 10.2196/52482.
8
Integrating Neural-Symbolic Reasoning With Variational Causal Inference Network for Explanatory Visual Question Answering.将神经符号推理与变分因果推理网络相结合用于可解释视觉问答
IEEE Trans Pattern Anal Mach Intell. 2024 Dec;46(12):7893-7908. doi: 10.1109/TPAMI.2024.3398012. Epub 2024 Nov 6.
9
A question-entailment approach to question answering.问题蕴涵方法在问答中的应用。
BMC Bioinformatics. 2019 Oct 22;20(1):511. doi: 10.1186/s12859-019-3119-4.
10
ExAID: A multimodal explanation framework for computer-aided diagnosis of skin lesions.EXAID:一种用于皮肤损伤计算机辅助诊断的多模态解释框架。
Comput Methods Programs Biomed. 2022 Mar;215:106620. doi: 10.1016/j.cmpb.2022.106620. Epub 2022 Jan 5.