DE eng

Search in the Catalogues and Directories

Hits 1 – 2 of 2

1
A Multilingual Benchmark for Probing Negation-Awareness with Minimal Pairs ...
Abstract: Negation is one of the most fundamental concepts in human cognition and language, and several natural language inference (NLI) probes have been designed to investigate pretrained language models' ability to detect and reason with negation. However, the existing probing datasets are limited to English only, and do not enable controlled probing of performance in the absence or presence of negation. In response, we present a multilingual (English, Bulgarian, German, French and Chinese) benchmark collection of NLI examples that are grammatical and correctly labeled, as a result of manual inspection and editing. We use the benchmark to probe the negation-awareness of multilingual language models and find that models that correctly predict examples with negation cues often fail to correctly predict their counter-examples without negation cues, even when the cues are irrelevant for semantic inference. ...
Keyword: Computational Linguistics; Machine Learning; Machine Learning and Data Mining; Natural Language Inference; Natural Language Processing
URL: https://underline.io/lecture/39880-a-multilingual-benchmark-for-probing-negation-awareness-with-minimal-pairs
https://dx.doi.org/10.48448/nmxw-4j45
BASE
Hide details
2
On Language Models for Creoles ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
2
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern