1 |
How much context span is enough? Examining context-related issues for document-level MT
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 (2022) How much context span is enough? Examining context-related issues for document-level MT. In: 13th Language Resources and Evaluation Conference, 21-23 June 2022, Marseille, France. (In Press) (2022)
|
|
BASE
|
|
Show details
|
|
2 |
DELA Corpus - A Document-Level Corpus Annotated with Context-Related Issues
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 , Cavalheiro Camargo, João Lucas orcid:0000-0003-3746-1225 , Menezes, Miguel and Way, Andy orcid:0000-0001-5736-5930 (2021) DELA Corpus - A Document-Level Corpus Annotated with Context-Related Issues. In: Sixth Conference on Machine Translation (WMT21), 10-11 Nov 2021, Punta Cana, Dominican Republic (Online). ISBN 978-1-954085-94-7 (2021)
|
|
BASE
|
|
Show details
|
|
3 |
Towards document-level human MT evaluation: On the Issues of annotator agreement, effort and misevaluation
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 (2021) Towards document-level human MT evaluation: On the Issues of annotator agreement, effort and misevaluation. In: 16th Conference of the European Chapter of the Association for Computational Linguistics - EACL 2021., 19-23 April 2021, Online. (In Press) (2021)
|
|
BASE
|
|
Show details
|
|
4 |
DELA Corpus - A Document-Level Corpus Annotated with Context-Related Issues ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
A human evaluation of English-Irish statistical and neural machine translation
|
|
|
|
In: Dowling, Meghan orcid:0000-0003-1637-4923 , Castilho, Sheila orcid:0000-0002-8416-6555 , Moorkens, Joss orcid:0000-0003-4864-5986 , Lynn, Teresa and Way, Andy orcid:0000-0001-5736-5930 (2020) A human evaluation of English-Irish statistical and neural machine translation. In: Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, 6 Nov 2020, Lisbon, Portugal. (2020)
|
|
BASE
|
|
Show details
|
|
6 |
A set of recommendations for assessing human-machine parity in language translation
|
|
|
|
In: Läubli, Samuel orcid:0000-0001-5362-4106 , Castilho, Sheila orcid:0000-0002-8416-6555 , Neubig, Graham, Sennrich, Rico orcid:0000-0002-1438-4741 , Shen, Qinlan and Toral, Antonio orcid:0000-0003-2357-2960 (2020) A set of recommendations for assessing human-machine parity in language translation. Journal of Artificial Intelligence Research, 67 . pp. 653-672. ISSN 1076-9757 (2020)
|
|
BASE
|
|
Show details
|
|
7 |
On the same page? Comparing inter-annotator agreement in sentence and document level human machine translation evaluation
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 (2020) On the same page? Comparing inter-annotator agreement in sentence and document level human machine translation evaluation. In: Fifth Conference on Machine Translation, 19-20 Nov 2020, Dominican Republic (Online). (2020)
|
|
BASE
|
|
Show details
|
|
8 |
A Set of Recommendations for Assessing Human-Machine Parity in Language Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Are ambiguous conjunctions problematic for machine translation?
|
|
|
|
In: Popović, Maja orcid:0000-0001-8234-8745 and Castilho, Sheila orcid:0000-0002-8416-6555 (2019) Are ambiguous conjunctions problematic for machine translation? In: Recent Advances in Natural Language Processing (RANLP 2019), 2 - 4 Sept 2019, Varna, Bulgaria. (2019)
|
|
BASE
|
|
Show details
|
|
10 |
What level of quality can neural machine translation attain on literary text?
|
|
|
|
In: Toral, Antonio orcid:0000-0003-2357-2960 and Way, Andy orcid:0000-0001-5736-5930 (2018) What level of quality can neural machine translation attain on literary text? In: Moorkens, Joss orcid:0000-0003-4864-5986 , Castilho, Sheila orcid:0000-0002-8416-6555 , Gaspari, Federico orcid:0000-0003-3808-8418 and Doherty, S, (eds.) Translation Quality Assessment: From Principles to Practice. Machine Translation: Technologies and Applications book series (MATRA), 1 . Springer, Berlin/Heidelberg, 263 -287. ISBN 978-3-319-91240-0 (2018)
|
|
BASE
|
|
Show details
|
|
11 |
Improving machine translation of educational content via crowdsourcing
|
|
|
|
In: Behnke, Maximiliana, Miceli Barone, Antonio Valerio, Sennrich, Rico, Sosoni, Vilelmini, Naskos, Thanasis, Takoulidou, Eirini, Stasimioti, Maria, Menno, van Zaanen, Castilho, Sheila orcid:0000-0002-8416-6555 , Gaspari, Federico orcid:0000-0003-3808-8418 , Georgakopoulou, Panayota orcid:0000-0001-9780-1813 , Kordoni, Valia, Egg, Markus and Kermanidis, Katia Lida orcid:0000-0002-3270-5078 (2018) Improving machine translation of educational content via crowdsourcing. In: LREC 2018 - 11th International Conference on Language Resources and Evaluation, Miyazaki, Japan. ISBN 979-10-95546-19-1 (2018)
|
|
BASE
|
|
Show details
|
|
12 |
Reading comprehension of machine translation output: what makes for a better read?
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 and Guerberof Arenas, Ana orcid:0000-0001-9820-7074 (2018) Reading comprehension of machine translation output: what makes for a better read? In: 21st Annual Conference of the European for Machine Translation, 28-30 May 2018, Alacant/Alicante, Spain. ISBN 978-84-09-01901-4 (2018)
|
|
BASE
|
|
Show details
|
|
13 |
Attaining the unattainable? Reassessing claims of human parity in neural machine translation
|
|
|
|
In: Toral, Antonio orcid:0000-0003-2357-2960 , Castilho, Sheila orcid:0000-0002-8416-6555 , Hu, Ke and Way, Andy orcid:0000-0001-5736-5930 (2018) Attaining the unattainable? Reassessing claims of human parity in neural machine translation. In: Third Conference on Machine Translation (WMT), 31 Oct- 1 Nov 2018, Brussels, Belgium. ISBN 978-1-948087-81-0 (2018)
|
|
Abstract:
We reassess a recent study (Hassan et al., 2018) that claimed that machine translation (MT) has reached human parity for the translation of news from Chinese into English, using pairwise ranking and considering three variables that were not taken into account in that previous study: the language in which the source side of the test set was originally written, the translation proficiency of the evaluators, and the provision of inter-sentential context. If we consider only original source text (i.e. not translated from another language, or translationese), then we find evidence showing that human parity has not been achieved. We compare the judgments of professional translators against those of non-experts and discover that those of the experts result in higher inter-annotator agreement and better discrimination between human and machine translations. In addition, we analyse the human translations of the test set and identify important translation issues. Finally, based on these findings, we provide a set of recommendations for future human evaluations of MT.
|
|
Keyword:
Machine translating
|
|
URL: http://doras.dcu.ie/23081/
|
|
BASE
|
|
Hide details
|
|
14 |
Translation crowdsourcing: creating a multilingual corpus of online educational content
|
|
|
|
In: Sosoni, Vilelmini orcid:0000-0002-9583-4651 , Kermanidis, Katia Lida orcid:0000-0002-3270-5078 , Stasimioti, Maria orcid:0000-0002-3270-5078 , Naskos, Thanasis, Takoulidou, Eirini, van Zaanen, Menno, Castilho, Sheila orcid:0000-0002-8416-6555 , Georgakopoulou, Panayota orcid:0000-0001-9780-1813 , Kordoni, Valia and Egg, Markus (2018) Translation crowdsourcing: creating a multilingual corpus of online educational content. In: 11th International Conference on Language Resources and Evaluation, 7-12 May 2018, Miyazaki, Japan. ISBN 979-10-95546-00-9 (2018)
|
|
BASE
|
|
Show details
|
|
15 |
Translation Quality, Quality Management and Agency: Principles and Practice in the European Union Institutions
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Integrating machine translation into MOOCS
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 , Gaspari, Federico orcid:0000-0003-3808-8418 , Moorkens, Joss orcid:0000-0003-4864-5986 and Way, Andy orcid:0000-0001-5736-5930 (2017) Integrating machine translation into MOOCS. In: EDULEARN17, 3-5 July 2017, Barcelona, Spain. ISBN 978-84-697-3777-4 (2017)
|
|
BASE
|
|
Show details
|
|
17 |
Translation dictation vs. post-editing with cloud-based voice recognition: a pilot experiment
|
|
|
|
In: Zapata, Julián, Castilho, Sheila orcid:0000-0002-8416-6555 and Moorkens, Joss orcid:0000-0003-0766-0071 (2017) Translation dictation vs. post-editing with cloud-based voice recognition: a pilot experiment. In: MT Summit XVI, 18-22 Sept 2017, At Nagoya, Japan. (2017)
|
|
BASE
|
|
Show details
|
|
18 |
Acceptability of machine-translated content: a multi-language evaluation by translators and end-users
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 and O'Brien, Sharon orcid:0000-0003-4864-5986 (2017) Acceptability of machine-translated content: a multi-language evaluation by translators and end-users. Linguistica Antverpiensia, New Series: Themes in Translation Studies, 16 . pp. 120-136. ISSN 2295-5739 (2017)
|
|
BASE
|
|
Show details
|
|
19 |
A comparative quality evaluation of PBSMT and NMT using professional translators
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 , Moorkens, Joss, Gaspari, Federico, Sennrich, Rico, Sosoni, Vilelmini, Georgakopoulou, Panayota, Lohar, Pintu, Way, Andy orcid:0000-0001-5736-5930 , Miceli Barone, Antonio Valerio and Gialama, Maria (2017) A comparative quality evaluation of PBSMT and NMT using professional translators. In: MT Summit XVI, 18-22 Sept 2017, Nagoya, Japan. (2017)
|
|
BASE
|
|
Show details
|
|
20 |
Is neural machine translation the new state of the art?
|
|
|
|
In: Castilho, Sheila orcid:0000-0002-8416-6555 , Moorkens, Joss orcid:0000-0003-0766-0071 , Gaspari, Federico orcid:0000-0003-3808-8418 , Calixto, Iacer, Tinsley, John and Way, Andy orcid:0000-0001-5736-5930 (2017) Is neural machine translation the new state of the art? The Prague Bulletin of Mathematical Linguistics (108). ISSN 0032-6585 (2017)
|
|
BASE
|
|
Show details
|
|
|
|