DE eng

Search in the Catalogues and Directories

Hits 1 – 7 of 7

1
Benchmarking Answer Verification Methods for Question Answering-Based Summarization Evaluation Metrics ...
Deutsch, Daniel; Roth, Dan. - : arXiv, 2022
BASE
Show details
2
Question-Based Salient Span Selection for More Controllable Text Summarization ...
Deutsch, Daniel; Roth, Dan. - : arXiv, 2021
BASE
Show details
3
A Statistical Analysis of Summarization Evaluation Metrics Using Resampling Methods ...
BASE
Show details
4
Understanding the Extent to which Content Quality Metrics Measure the Information Quality of Summaries ...
BASE
Show details
5
Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary ...
Abstract: Read paper: NA Abstract: A desirable property of a reference-based evaluation metric that measures the content quality of a summary is that it should estimate how much information that summary has in common with a reference. Traditional text overlap based metrics such as ROUGE fail to achieve this because they are limited to matching tokens, either lexically or via embeddings. In this work, we propose a metric to evaluate the content quality of a summary using question-answering (QA). QA-based methods directly measure a summary's information overlap with a reference, making them fundamentally different than text overlap metrics. We demonstrate the experimental benefits of QA-based metrics through an analysis of our proposed metric, QAEval. QAEval out-performs current state-of-the-art metrics on most evaluations using benchmark datasets, while being competitive on others due to limitations of state-of-the-art models. Through a careful analysis of each component of QAEval, we identify its performance ...
Keyword: Computational Linguistics; Condensed Matter Physics; Deep Learning; Electromagnetism; FOS Physical sciences; Information and Knowledge Engineering; Neural Network; Semantics
URL: https://underline.io/lecture/25674-towards-question-answering-as-an-automatic-metric-for-evaluating-the-content-quality-of-a-summary
https://dx.doi.org/10.48448/8mje-vj15
BASE
Hide details
6
Is Killed More Significant than Fled? A Contextual Model for Salient Event Detection ...
BASE
Show details
7
Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
7
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern