- Overview of RepLab 2012: Evaluating Online Reputation Management Systems
- CEUR Workshop Proceedings
- Document type
- Faculty of Science (FNWI)
- Informatics Institute (IVI)
This paper summarizes the goals, organization and results of the first RepLab competitive evaluation campaign for Online Reputation Management Systems (RepLab 2012). RepLab focused on the reputation of companies, and asked participant systems to annotate different types of information on tweets containing the names of several companies. Two tasks were proposed: a profiling task, where tweets had to be annotated for relevance and polarity for reputation, and a monitoring task, where tweets had to be clustered thematically and clusters had to be ordered by priority (for reputation management purposes). The gold standard consisted of annotations made by reputation management experts, a feature which turns the RepLab 2012 test collection in a useful source not only to evaluate systems, but also to reach a better understanding of the notions of polarity and priority in the context of reputation management.
- Proceedings title: CLEF 2012: working notes for CLEF 2012 Conference: Rome, Italy, September 17-20, 2012
Place of publication: Aachen
Editors: P. Forner, J. Karlgren, C. Womser-Hacker, N. Ferro
If you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library, or send a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible.