Overview and Discussion of the Competition on Legal Information, Extraction/Entailment (COLIEE) 2023.

Rev Socionetwork Strateg

Faculty of Information Science and Technology, Hokkaido University, Sapporo-shi, Hokkaido Japan.

Published: January 2024

We summarize the 10th Competition on Legal Information Extraction and Entailment. In this tenth edition, the competition included four tasks on case law and statute law. The case law component includes an information retrieval task (Task 1), and the confirmation of an entailment relation between an existing case and a selected unseen case (Task 2). The statute law component includes an information retrieval task (Task 3), and an entailment/question-answering task based on retrieved civil code statutes (Task 4). Participation was open to any group based on any approach. Ten different teams participated in the case law competition tasks, most of them in more than one task. We received results from 8 teams for Task 1 (22 runs) and seven teams for Task 2 (18 runs). On the statute law task, there were 9 different teams participating, most in more than one task. 6 teams submitted a total of 16 runs for Task 3, and 9 teams submitted a total of 26 runs for Task 4. We describe the variety of approaches, our official evaluation, and analysis of our data and submission results.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11026282PMC
http://dx.doi.org/10.1007/s12626-023-00152-0DOI Listing

Publication Analysis

Top Keywords

task
14
case law
12
statute law
12
task teams
12
competition legal
8
law component
8
component includes
8
includes retrieval
8
retrieval task
8
task task
8

Similar Publications

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!