2 |
How Conservative are Language Models? Adapting to the Introduction of Gender-Neutral Pronouns ...
|
|
|
|
Abstract:
Gender-neutral pronouns have recently been introduced in many languages to a) include non-binary people and b) as a generic singular. Recent results from psycho-linguistics suggest that gender-neutral pronouns (in Swedish) are not associated with human processing difficulties. This, we show, is in sharp contrast with automated processing. We show that gender-neutral pronouns in Danish, English, and Swedish are associated with higher perplexity, more dispersed attention patterns, and worse downstream performance. We argue that such conservativity in language models may limit widespread adoption of gender-neutral pronouns and must therefore be resolved. ... : To appear at NAACL 2022 ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2204.10281 https://arxiv.org/abs/2204.10281
|
|
BASE
|
|
Hide details
|
|
3 |
Times Are Changing: Investigating the Pace of Language Change in Diachronic Word Embeddings ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Times Are Changing: Investigating the Pace of Language Change in Diachronic Word Embeddings ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|