DE eng

Search in the Catalogues and Directories

Hits 1 – 8 of 8

1
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics ...
BASE
Show details
2
One Model, Many Languages: Meta-learning for Multilingual Text-to-Speech ...
BASE
Show details
3
Neural Generation for Czech: Data and Baselines ...
BASE
Show details
4
Evaluating the State-of-the-Art of End-to-End Natural Language Generation: The E2E NLG Challenge ...
BASE
Show details
5
RankME: Reliable Human Ratings for Natural Language Generation ...
Abstract: Human evaluation for natural language generation (NLG) often suffers from inconsistent user ratings. While previous research tends to attribute this problem to individual user preferences, we show that the quality of human judgements can also be improved by experimental design. We present a novel rank-based magnitude estimation method (RankME), which combines the use of continuous scales and relative assessments. We show that RankME significantly improves the reliability and consistency of human ratings compared to traditional evaluation methods. In addition, we show that it is possible to evaluate NLG systems according to multiple, distinct criteria, which is important for error analysis. Finally, we demonstrate that RankME, in combination with Bayesian estimation of system quality, is a cost-effective alternative for ranking multiple NLG systems. ... : Accepted to NAACL 2018 (The 2018 Conference of the North American Chapter of the Association for Computational Linguistics) ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://dx.doi.org/10.48550/arxiv.1803.05928
https://arxiv.org/abs/1803.05928
BASE
Hide details
6
Better Conversations by Modeling,Filtering,and Optimizing for Coherence and Diversity ...
BASE
Show details
7
Findings of the E2E NLG Challenge ...
BASE
Show details
8
The E2E Dataset: New Challenges For End-to-End Generation ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
8
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern