Pytrec_eval: An Extremely Fast Python Interface to TREC_eval

Authors
Publication date 2018
Book title SIGIR #41 proceedings
Book subtitle Ann Arbor, Michigan, USA, 08-12, July 2018
ISBN (electronic)
  • 9781450356572
Event 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018
Pages (from-to) 873-876
Number of pages 4
Publisher New York, NY: Association for Computing Machinery
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract

We introduce pytrec_eval, a Python interface to the trec_eval information retrieval evaluation toolkit. pytrec_eval exposes the reference implementations of trec_eval within Python as a native extension. We show that pytrec_eval is around one order of magnitude faster than invoking trec_eval as a sub process from within Python. Compared to a native Python implementation of NDCG, pytrec_eval is twice as fast for practically-sized rankings. Finally, we demonstrate its effectiveness in an application where pytrec_eval is combined with Pyndri and the OpenAI Gym where query expansion is learned using Q-learning.

Document type Conference contribution
Language English
Published at https://doi.org/10.1145/3209978.3210065
Other links https://www.scopus.com/pages/publications/85051566202
Permalink to this page
Back