Please use this identifier to cite or link to this item:
http://hdl.handle.net/10609/150203
Title: | What do post-editors correct? A fine-grained analysis of SMT and NMT errors |
Author: | Alvarez Vidal, Sergi Oliver, Antoni Badia, Toni |
Citation: | Álvarez Vidal, S. [Sergi], Oliver, A. [Antoni] & Badia, T. [Toni]. (2021). What do post-editors correct? A fine-grained analysis of SMT and NMT errors. Revista Tradumàtica, 19, 131-147. doi: 10.5565/rev/tradumatica.286 |
Abstract: | The recent improvements in neural MT (NMT) have driven a shift from statistical MT (SMT) to NMT. However, to assess the usefulness of MT models for post-editing (PE) and have a detailed insight of the output they produce, we need to analyse the most frequent errors and how they affect the task. We present a pilot study of a fine-grained analysis of MT errors based on post-editors corrections for an English to Spanish medical text translated with SMT and NMT. We use the MQM taxonomy to compare the two MT models and have a categorized classification of the errors produced. Even though results show a great variation among posteditors’ corrections, for this language combination fewer errors are corrected by post-editors in the NMT output. NMT also produces fewer accuracy errors and errors that are less critical. |
Keywords: | machine translation MT NMT post-editing neuram machine translation error taxonomy |
DOI: | https://doi.org/10.5565/rev/tradumatica.286 |
Document type: | info:eu-repo/semantics/article |
Version: | info:eu-repo/semantics/publishedVersion |
Issue Date: | 31-Dec-2021 |
Publication license: | http://creativecommons.org/licenses/by/4.0/es/ |
Appears in Collections: | Articles Articles cientÍfics |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
286-Text de l'article-1404-1-10-20211231.pdf | Published article | 505,4 kB | Adobe PDF | View/Open |
Share:
This item is licensed under aCreative Commons License