Findings of the 2010 Joint Workshop on Statistical Machine Translation and Metrics for Machine Translation

Authors
  • C. Callison-Burch
  • P. Koehn
  • C. Monz
  • K. Peterson
  • M. Przybocki
  • O.F. Zaidan
Publication date 2010
Book title Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR: ACL 2010: proceedings of the workshop: 15-16 July 2010, Uppsale University, Uppsala, Sweden
ISBN
  • 9781932432718
Event Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR
Pages (from-to) 17-53
Publisher Stroudsburg, PA: Association for Computational Linguistics
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract This paper presents the results of the WMT10 and MetricsMATR10 shared tasks, which included a translation task, a system combination task, and an evaluation task. We conducted a large-scale
manual evaluation of 104 machine translation systems and 41 system combination entries. We used the ranking of these systems to measure how strongly automatic metrics correlate with human judgments of translation quality for 26 metrics. This year we also investigated increasing the number of human judgments by hiring non-expert annotators through Amazon’s Mechanical Turk.
Document type Conference contribution
Language English
Published at http://www.aclweb.org/anthology/W/W10/W10-1703.pdf
Permalink to this page
Back