DE eng

Search in the Catalogues and Directories

Hits 1 – 2 of 2

1
Statistically significant detection of semantic shifts using contextual word embeddings ...
BASE
Show details
2
Statistically Significant Detection of Semantic Shifts using Contextual Word Embeddings ...
Abstract: Detecting lexical semantic change in smaller data sets, e.g. in historical linguistics and digital humanities, is challenging due to a lack of statistical power. This issue is exacerbated by non-contextual embedding models that produce one embedding per word and, therefore, mask the variability present in the data. In this article, we propose an approach to estimate semantic shift by combining contextual word embeddings with permutation-based statistical tests. We use the false discovery rate procedure to address the large number of hypothesis tests being conducted simultaneously. We demonstrate the performance of this approach in simulation where it achieves consistently high precision by suppressing false positives. We additionally analyze real-world data from SemEval-2020 Task 1 and the Liverpool FC subreddit corpus. We show that by taking sample variation into account, we can improve the robustness of individual semantic shift estimates without degrading overall performance. ...
Keyword: Computational Linguistics; Machine Learning; Natural Language Processing
URL: https://underline.io/lecture/39283-statistically-significant-detection-of-semantic-shifts-using-contextual-word-embeddings
https://dx.doi.org/10.48448/4qhk-jd49
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
2
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern