- Findings of the 2010 Joint Workshop on Statistical Machine Translation and Metrics for Machine Translation
- Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR
- Book/source title
- Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR: ACL 2010: proceedings of the workshop: 15-16 July 2010, Uppsale University, Uppsala, Sweden
- Pages (from-to)
- Stroudsburg, PA: Association for Computational Linguistics
- Document type
- Conference contribution
- Faculty of Science (FNWI)
- Informatics Institute (IVI)
This paper presents the results of the WMT10 and MetricsMATR10 shared tasks, which included a translation task, a system combination task, and an evaluation task. We conducted a large-scale
manual evaluation of 104 machine translation systems and 41 system combination entries. We used the ranking of these systems to measure how strongly automatic metrics correlate with human judgments of translation quality for 26 metrics. This year we also investigated increasing the number of human judgments by hiring non-expert annotators through Amazon’s Mechanical Turk.
If you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library, or send a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible.