DE eng

Search in the Catalogues and Directories

Page: 1 2 3 4 5 6 7
Hits 21 – 40 of 135

21
The (Un)Suitability of Automatic Evaluation Metrics for Text Simplification ...
BASE
Show details
22
Improving Dialogue State Tracking with Turn-based Loss Function and Sequential Data Augmentation
BASE
Show details
23
Knowledge distillation for quality estimation
Gajbhiye, Amit; Fomicheva, Marina; Alva-Manchego, Fernando. - : Association for Computational Linguistics, 2021
BASE
Show details
24
deepQuest-py: large and distilled models for quality estimation
Alva-Manchego, Fernando; Obamuyide, Abiola; Gajbhiye, Amit. - : Association for Computational Linguistics, 2021
BASE
Show details
25
Read, spot and translate
In: Mach Transl (2021)
BASE
Show details
26
The (un)suitability of automatic evaluation metrics for text simplification
Alva Manchego, Fernando; Scarton, Carolina; Specia, Lucia. - : Association for Computational Linguistics, 2021
Abstract: In order to simplify sentences, several rewriting operations can be performed, such as replacing complex words per simpler synonyms, deleting unnecessary information, and splitting long sentences. Despite this multi-operation nature, evaluation of automatic simplification systems relies on metrics that moderately correlate with human judgments on the simplicity achieved by executing specific operations (e.g., simplicity gain based on lexical replacements). In this article, we investigate how well existing metrics can assess sentence-level simplifications where multiple operations may have been applied and which, therefore, require more general simplicity judgments. For that, we first collect a new and more reliable data set for evaluating the correlation of metrics and human judgments of overall simplicity. Second, we conduct the first meta-evaluation of automatic metrics in Text Simplification, using our new data set (and other existing data) to analyze the variation of the correlation between metrics’ scores and human judgments across three dimensions: the perceived simplicity level, the system type, and the set of references used for computation. We show that these three aspects affect the correlations and, in particular, highlight the limitations of commonly used operation-specific metrics. Finally, based on our findings, we propose a set of recommendations for automatic evaluation of multi-operation simplifications, suggesting which metrics to compute and how to interpret their scores.
URL: https://orca.cardiff.ac.uk/147256/
https://doi.org/10.1162/coli_a_00418
https://orca.cardiff.ac.uk/147256/1/coli_a_00418.pdf
BASE
Hide details
27
Findings of the WMT 2021 shared task on quality estimation
In: 689 ; 730 (2021)
BASE
Show details
28
deepQuest-py: large and distilled models for quality estimation
In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations ; 382 ; 389 (2021)
BASE
Show details
29
Backtranslation feedback improves user confidence in MT, not quality
Obregón, Mateo; Fomicheva, Marina; Novák, Michal. - : Association for Computational Linguistics, 2021
BASE
Show details
30
Robust fragment-based framework for cross-lingual sentence retrieval
In: Findings of the Association for Computational Linguistics: EMNLP 2021 ; 935 ; 944 (2021)
BASE
Show details
31
Knowledge distillation for quality estimation
In: 5091 ; 5099 (2021)
BASE
Show details
32
Come hither or go away? Recognising pre-electoral coalition signals in the news
Rehbein, Ines; Ponzetto, Simone Paolo; Adendorf, Anna. - : Association for Computational Linguistics, 2021
BASE
Show details
33
ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations
In: ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics ; https://hal.inria.fr/hal-02889823 ; ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Jul 2020, Seattle / Virtual, United States (2020)
BASE
Show details
34
MLQE-PE: A Multilingual Quality Estimation and Post-Editing Dataset ...
BASE
Show details
35
MSVD-Turkish: A Comprehensive Multimodal Dataset for Integrated Vision and Language Research in Turkish ...
BASE
Show details
36
ASSET: A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations ...
BASE
Show details
37
Simultaneous Machine Translation with Visual Context ...
BASE
Show details
38
ASSET: A dataset for tuning and evaluation of sentence simplification models with multiple rewriting transformations
BASE
Show details
39
Quality in, quality out: learning from actual mistakes
Blain, Frédéric; Aletras, Nikos; Specia, Lucia. - : European Association for Machine Translation, 2020
BASE
Show details
40
Unsupervised quality estimation for neural machine translation
In: 8 ; 539 ; 555 (2020)
BASE
Show details

Page: 1 2 3 4 5 6 7

Catalogues
1
0
5
0
7
0
0
Bibliographies
1
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
122
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern