Pytrec_eval: An Extremely Fast Python Interface to TREC_eval
| Authors | |
|---|---|
| Publication date | 2018 |
| Book title | SIGIR #41 proceedings |
| Book subtitle | Ann Arbor, Michigan, USA, 08-12, July 2018 |
| ISBN (electronic) |
|
| Event | 41st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2018 |
| Pages (from-to) | 873-876 |
| Number of pages | 4 |
| Publisher | New York, NY: Association for Computing Machinery |
| Organisations |
|
| Abstract |
We introduce pytrec_eval, a Python interface to the trec_eval information retrieval evaluation toolkit. pytrec_eval exposes the reference implementations of trec_eval within Python as a native extension. We show that pytrec_eval is around one order of magnitude faster than invoking trec_eval as a sub process from within Python. Compared to a native Python implementation of NDCG, pytrec_eval is twice as fast for practically-sized rankings. Finally, we demonstrate its effectiveness in an application where pytrec_eval is combined with Pyndri and the OpenAI Gym where query expansion is learned using Q-learning. |
| Document type | Conference contribution |
| Language | English |
| Published at | https://doi.org/10.1145/3209978.3210065 |
| Other links | https://www.scopus.com/pages/publications/85051566202 |
| Permalink to this page | |
