1 |
How much context span is enough? Examining context-related issues for document-level MT
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 (2022) How much context span is enough? Examining context-related issues for document-level MT. In: 13th Language Resources and Evaluation Conference, 21-23 June 2022, Marseille, France. (In Press) (2022)
|
|
BASE
|
|
Show details
|
|
2 |
DELA Corpus - A Document-Level Corpus Annotated with Context-Related Issues
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 , Cavalheiro Camargo, João Lucas orcid:0000-0003-3746-1225 , Menezes, Miguel and Way, Andy orcid:0000-0001-5736-5930 (2021) DELA Corpus - A Document-Level Corpus Annotated with Context-Related Issues. In: Sixth Conference on Machine Translation (WMT21), 10-11 Nov 2021, Punta Cana, Dominican Republic (Online). ISBN 978-1-954085-94-7 (2021)
|
|
BASE
|
|
Show details
|
|
3 |
Towards document-level human MT evaluation: On the Issues of annotator agreement, effort and misevaluation
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 (2021) Towards document-level human MT evaluation: On the Issues of annotator agreement, effort and misevaluation. In: 16th Conference of the European Chapter of the Association for Computational Linguistics - EACL 2021., 19-23 April 2021, Online. (In Press) (2021)
|
|
BASE
|
|
Show details
|
|
4 |
DELA Corpus - A Document-Level Corpus Annotated with Context-Related Issues ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
A human evaluation of English-Irish statistical and neural machine translation
|
|
|
|
In: Dowling, Meghan orcid:0000-0003-1637-4923 , Castilho, Sheila orcid:0000-0002-8416-6555 , Moorkens, Joss orcid:0000-0003-4864-5986 , Lynn, Teresa and Way, Andy orcid:0000-0001-5736-5930 (2020) A human evaluation of English-Irish statistical and neural machine translation. In: Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, 6 Nov 2020, Lisbon, Portugal. (2020)
|
|
BASE
|
|
Show details
|
|
6 |
A set of recommendations for assessing human-machine parity in language translation
|
|
|
|
In: Läubli, Samuel orcid:0000-0001-5362-4106 , Castilho, Sheila orcid:0000-0002-8416-6555 , Neubig, Graham, Sennrich, Rico orcid:0000-0002-1438-4741 , Shen, Qinlan and Toral, Antonio orcid:0000-0003-2357-2960 (2020) A set of recommendations for assessing human-machine parity in language translation. Journal of Artificial Intelligence Research, 67 . pp. 653-672. ISSN 1076-9757 (2020)
|
|
Abstract:
The quality of machine translation has increased remarkably over the past years, to the degree that it was found to be indistinguishable from professional human translation in a number of empirical investigations. We reassess Hassan et al.’s 2018 investigation into Chinese to English news translation, showing that the finding of human–machine parity was owed to weaknesses in the evaluation design—which is currently considered best practice in the field. We show that the professional human translations contained significantly fewer errors, and that perceived quality in human evaluation depends on the choice of raters, the availability of linguistic context, and the creation of reference translations. Our results call for revisiting current best practices to assess strong machine translation systems in general and human–machine parity in particular, for which we offer a set of recommendations based on our empirical findings.
|
|
Keyword:
human evaluation of machine translation; Machine translating; Translating and interpreting
|
|
URL: http://doras.dcu.ie/24536/
|
|
BASE
|
|
Hide details
|
|
7 |
On the same page? Comparing inter-annotator agreement in sentence and document level human machine translation evaluation
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 (2020) On the same page? Comparing inter-annotator agreement in sentence and document level human machine translation evaluation. In: Fifth Conference on Machine Translation, 19-20 Nov 2020, Dominican Republic (Online). (2020)
|
|
BASE
|
|
Show details
|
|
8 |
A Set of Recommendations for Assessing Human-Machine Parity in Language Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Are ambiguous conjunctions problematic for machine translation?
|
|
|
|
In: Popović, Maja orcid:0000-0001-8234-8745 and Castilho, Sheila orcid:0000-0002-8416-6555 (2019) Are ambiguous conjunctions problematic for machine translation? In: Recent Advances in Natural Language Processing (RANLP 2019), 2 - 4 Sept 2019, Varna, Bulgaria. (2019)
|
|
BASE
|
|
Show details
|
|
10 |
What level of quality can neural machine translation attain on literary text?
|
|
|
|
In: Toral, Antonio orcid:0000-0003-2357-2960 and Way, Andy orcid:0000-0001-5736-5930 (2018) What level of quality can neural machine translation attain on literary text? In: Moorkens, Joss orcid:0000-0003-4864-5986 , Castilho, Sheila orcid:0000-0002-8416-6555 , Gaspari, Federico orcid:0000-0003-3808-8418 and Doherty, S, (eds.) Translation Quality Assessment: From Principles to Practice. Machine Translation: Technologies and Applications book series (MATRA), 1 . Springer, Berlin/Heidelberg, 263 -287. ISBN 978-3-319-91240-0 (2018)
|
|
BASE
|
|
Show details
|
|
11 |
Improving machine translation of educational content via crowdsourcing
|
|
|
|
In: Behnke, Maximiliana, Miceli Barone, Antonio Valerio, Sennrich, Rico, Sosoni, Vilelmini, Naskos, Thanasis, Takoulidou, Eirini, Stasimioti, Maria, Menno, van Zaanen, Castilho, Sheila orcid:0000-0002-8416-6555 , Gaspari, Federico orcid:0000-0003-3808-8418 , Georgakopoulou, Panayota orcid:0000-0001-9780-1813 , Kordoni, Valia, Egg, Markus and Kermanidis, Katia Lida orcid:0000-0002-3270-5078 (2018) Improving machine translation of educational content via crowdsourcing. In: LREC 2018 - 11th International Conference on Language Resources and Evaluation, Miyazaki, Japan. ISBN 979-10-95546-19-1 (2018)
|
|
BASE
|
|
Show details
|
|
12 |
Reading comprehension of machine translation output: what makes for a better read?
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 and Guerberof Arenas, Ana orcid:0000-0001-9820-7074 (2018) Reading comprehension of machine translation output: what makes for a better read? In: 21st Annual Conference of the European for Machine Translation, 28-30 May 2018, Alacant/Alicante, Spain. ISBN 978-84-09-01901-4 (2018)
|
|
BASE
|
|
Show details
|
|
13 |
Attaining the unattainable? Reassessing claims of human parity in neural machine translation
|
|
|
|
In: Toral, Antonio orcid:0000-0003-2357-2960 , Castilho, Sheila orcid:0000-0002-8416-6555 , Hu, Ke and Way, Andy orcid:0000-0001-5736-5930 (2018) Attaining the unattainable? Reassessing claims of human parity in neural machine translation. In: Third Conference on Machine Translation (WMT), 31 Oct- 1 Nov 2018, Brussels, Belgium. ISBN 978-1-948087-81-0 (2018)
|
|
BASE
|
|
Show details
|
|
14 |
Translation crowdsourcing: creating a multilingual corpus of online educational content
|
|
|
|
In: Sosoni, Vilelmini orcid:0000-0002-9583-4651 , Kermanidis, Katia Lida orcid:0000-0002-3270-5078 , Stasimioti, Maria orcid:0000-0002-3270-5078 , Naskos, Thanasis, Takoulidou, Eirini, van Zaanen, Menno, Castilho, Sheila orcid:0000-0002-8416-6555 , Georgakopoulou, Panayota orcid:0000-0001-9780-1813 , Kordoni, Valia and Egg, Markus (2018) Translation crowdsourcing: creating a multilingual corpus of online educational content. In: 11th International Conference on Language Resources and Evaluation, 7-12 May 2018, Miyazaki, Japan. ISBN 979-10-95546-00-9 (2018)
|
|
BASE
|
|
Show details
|
|
15 |
Translation Quality, Quality Management and Agency: Principles and Practice in the European Union Institutions
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Integrating machine translation into MOOCS
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 , Gaspari, Federico orcid:0000-0003-3808-8418 , Moorkens, Joss orcid:0000-0003-4864-5986 and Way, Andy orcid:0000-0001-5736-5930 (2017) Integrating machine translation into MOOCS. In: EDULEARN17, 3-5 July 2017, Barcelona, Spain. ISBN 978-84-697-3777-4 (2017)
|
|
BASE
|
|
Show details
|
|
17 |
Translation dictation vs. post-editing with cloud-based voice recognition: a pilot experiment
|
|
|
|
In: Zapata, Julián, Castilho, Sheila orcid:0000-0002-8416-6555 and Moorkens, Joss orcid:0000-0003-0766-0071 (2017) Translation dictation vs. post-editing with cloud-based voice recognition: a pilot experiment. In: MT Summit XVI, 18-22 Sept 2017, At Nagoya, Japan. (2017)
|
|
BASE
|
|
Show details
|
|
18 |
Acceptability of machine-translated content: a multi-language evaluation by translators and end-users
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 and O'Brien, Sharon orcid:0000-0003-4864-5986 (2017) Acceptability of machine-translated content: a multi-language evaluation by translators and end-users. Linguistica Antverpiensia, New Series: Themes in Translation Studies, 16 . pp. 120-136. ISSN 2295-5739 (2017)
|
|
BASE
|
|
Show details
|
|
19 |
A comparative quality evaluation of PBSMT and NMT using professional translators
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 , Moorkens, Joss, Gaspari, Federico, Sennrich, Rico, Sosoni, Vilelmini, Georgakopoulou, Panayota, Lohar, Pintu, Way, Andy orcid:0000-0001-5736-5930 , Miceli Barone, Antonio Valerio and Gialama, Maria (2017) A comparative quality evaluation of PBSMT and NMT using professional translators. In: MT Summit XVI, 18-22 Sept 2017, Nagoya, Japan. (2017)
|
|
BASE
|
|
Show details
|
|
20 |
Is neural machine translation the new state of the art?
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 , Moorkens, Joss orcid:0000-0003-0766-0071 , Gaspari, Federico orcid:0000-0003-3808-8418 , Calixto, Iacer, Tinsley, John and Way, Andy orcid:0000-0001-5736-5930 (2017) Is neural machine translation the new state of the art? The Prague Bulletin of Mathematical Linguistics (108). ISSN 0032-6585 (2017)
|
|
BASE
|
|
Show details
|
|
|
|