Suppr超能文献

Overview and Discussion of the Competition on Legal Information, Extraction/Entailment (COLIEE) 2023.

作者信息

Goebel Randy, Kano Yoshinobu, Kim Mi-Young, Rabelo Juliano, Satoh Ken, Yoshioka Masaharu

机构信息

Department of Computing Science and Alberta Machine Intelligence Institute, University of Alberta, Edmonton, AB Canada.

Faculty of Informatics, Shizuoka University, Hamamatsu, Shizuoka, Japan.

出版信息

Rev Socionetwork Strateg. 2024;18(1):27-47. doi: 10.1007/s12626-023-00152-0. Epub 2024 Jan 12.

Abstract

We summarize the 10th Competition on Legal Information Extraction and Entailment. In this tenth edition, the competition included four tasks on case law and statute law. The case law component includes an information retrieval task (Task 1), and the confirmation of an entailment relation between an existing case and a selected unseen case (Task 2). The statute law component includes an information retrieval task (Task 3), and an entailment/question-answering task based on retrieved civil code statutes (Task 4). Participation was open to any group based on any approach. Ten different teams participated in the case law competition tasks, most of them in more than one task. We received results from 8 teams for Task 1 (22 runs) and seven teams for Task 2 (18 runs). On the statute law task, there were 9 different teams participating, most in more than one task. 6 teams submitted a total of 16 runs for Task 3, and 9 teams submitted a total of 26 runs for Task 4. We describe the variety of approaches, our official evaluation, and analysis of our data and submission results.

摘要
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2026/11026282/b7b23a2d65dc/12626_2023_152_Fig1_HTML.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验