Overview of the CLEF 2023 SimpleText Task 1 Passage Selection for a Simplified Summary

Open Access
Authors
  • É. SanJuan
  • S. Huet
  • J. Kamps ORCID logo
  • L. Ermakova
Publication date 2023
Host editors
  • M. Aliannejadi
  • G. Faggioli
  • N. Ferro
  • M. Vlachos
Book title Working Notes of the Conference and Labs of the Evaluation Forum (CLEF 2023)
Book subtitle Thessaloniki, Greece, September 18th to 21st, 2023
Series CEUR Workshop Proceedings
Event 24th Working Notes of the Conference and Labs of the Evaluation Forum, CLEF-WN 2023
Article number 238
Pages (from-to) 2823-2834
Number of pages 12
Publisher Aachen: CEUR-WS
Organisations
  • Interfacultary Research - Institute for Logic, Language and Computation (ILLC)
Abstract

This paper presents an overview of the CLEF 2023 SimpleText Task 1: Content Selection, asking systems to retrieve scientific abstracts in response to a query prompted by a popular science article. Overall, the SimpleText track provides an evaluation platform for the automatic simplification of scientific texts. We discuss the details of the task set-up. First, the SimpleText Corpus with over 4 million academic papers and abstracts. Second, the Topics based on 40 popular science articles in the news and the 114 Queries prompted by them. Third, the Formats of requests and results, the Evaluation labels and Evaluation measures used. Fourth, the Results of the runs submitted by our participants.

Document type Conference contribution
Language English
Published at https://ceur-ws.org/Vol-3497/paper-238.pdf
Other links https://ceur-ws.org/Vol-3497/ https://www.scopus.com/pages/publications/85175608870
Downloads
paper-238 (Final published version)
Permalink to this page
Back