Overview of the CLEF 2023 SimpleText Task 3 Simplification of Scientific Texts

This article provides a comprehensive summary of the CLEF 2023 SimpleText Task 3, which focuses on simplifying scientific text based on specific queries. The paper begins by explaining the motivation behind the task and providing an overview of the overall setup. It then proceeds to describe the test collection in detail, which includes a training set of sentences extracted from scientific abstracts along with corresponding simplified sentences created by human annotators. Additionally, a comprehensive test corpus of sentences is introduced, accompanied by meticulous annotations of lexical and syntactic complexity. The article concludes with an in-depth analysis, including information distortion and LLM hallucinations, of the simplified sentences submitted by participants and the resulting evaluation scores.