DE eng

Search in the Catalogues and Directories

Hits 1 – 5 of 5

1
Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models ...
Abstract: This paper proposes two intuitive metrics, skew and stereotype, that quantify and analyse the gender bias present in contextual language models when tackling the WinoBias pronoun resolution task. We find evidence that gender stereotype correlates approximately negatively with gender skew in out-of-the-box models, suggesting that there is a trade-off between these two forms of bias. We investigate two methods to mitigate bias. The first approach is an online method which is effective at removing skew at the expense of stereotype. The second, inspired by previous work on ELMo, involves the fine-tuning of BERT using an augmented gender-balanced dataset. We show that this reduces both skew and stereotype relative to its unaugmented fine-tuned counterpart. However, we find that existing gender bias benchmarks do not fully probe professional bias as pronoun resolution may be obfuscated by cross-correlations from other manifestations of gender prejudice. Our code is available online, at ... : Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2021) ...
Keyword: Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG; Neural and Evolutionary Computing cs.NE
URL: https://dx.doi.org/10.48550/arxiv.2101.09688
https://arxiv.org/abs/2101.09688
BASE
Hide details
2
Training Adaptive Computation for Open-Domain Question Answering with Computational Constraints ...
BASE
Show details
3
NLProlog: Reasoning with Weak Unification for Question Answering in Natural Language ...
BASE
Show details
4
Jack the Reader - A Machine Reading Framework ...
BASE
Show details
5
Adversarially Regularising Neural NLI Models to Integrate Logical Background Knowledge ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
5
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern