1 |
49 - A test-suite for the evaluation of Portuguese-English machine translations ...
|
|
|
|
Abstract:
Read full paper: https://link.springer.com/chapter/10.1007/978-3-030-98305-5_2 Abstract: This paper describes the development of the first test suite for the language direction Portuguese-English. Designed for fine-grained linguistic analysis, the test suite comprises 330 test sentences for 66 linguistic phenomena and 14 linguistic categories. Eight different MT systems were compared using quantitative and qualitative methods via the test suite: DeepL, Google Sheets, Google Translator, Microsoft Translator, Reverso, Systran, Yandex and an internally built NMT system trained over 30 hours on 2,5M sentences. It was found that ambiguity, named entity & terminology and verb valency are the categories where MT systems struggle most. Negation, pronouns, subordination, verb tense/aspect/mood and false friends are the categories where MT systems perform best. ...
|
|
URL: https://underline.io/lecture/48032-49---a-test-suite-for-the-evaluation-of-portuguese-english-machine-translations https://dx.doi.org/10.48448/e5cw-my14
|
|
BASE
|
|
Hide details
|
|
2 |
A Data Augmentation Approach for Sign-Language-To-Text Translation In-The-Wild ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Observing the Learning Curve of Neural Machine Translation with regard to Linguistic Phenomena ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Fine-grained linguistic evaluation for state-of-the-art Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Comparative Quality Estimation for Machine Translation. An Application of Artificial Intelligence on Language Technology using Machine Learning of Human Preferences ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Fine-grained evaluation of German-English Machine Translation based on a Test Suite ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Linguistic evaluation of German-English Machine Translation using a Test Suite ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Comparative Quality Estimation for Machine Translation. An Application of Artificial Intelligence on Language Technology using Machine Learning of Human Preferences
|
|
|
|
BASE
|
|
Show details
|
|
10 |
QE::GUI – A Graphical User Interface for Quality Estimation
|
|
|
|
In: Prague Bulletin of Mathematical Linguistics , Vol 109, Iss 1, Pp 51-60 (2017) (2017)
|
|
BASE
|
|
Show details
|
|
11 |
Comparative Quality Estimation for Machine Translation Observations on Machine Learning and Features
|
|
|
|
In: Prague Bulletin of Mathematical Linguistics , Vol 108, Iss 1, Pp 307-318 (2017) (2017)
|
|
BASE
|
|
Show details
|
|
12 |
Qualitative: Python Tool for MT Quality Estimation Supporting Server Mode and Hybrid MT
|
|
|
|
In: Prague Bulletin of Mathematical Linguistics , Vol 106, Iss 1, Pp 147-158 (2016) (2016)
|
|
BASE
|
|
Show details
|
|
13 |
MT-ComparEval: Graphical evaluation interface for Machine Translation development
|
|
|
|
In: Prague Bulletin of Mathematical Linguistics , Vol 104, Iss 1, Pp 63-74 (2015) (2015)
|
|
BASE
|
|
Show details
|
|
|
|