1 |
Sample-efficient Linguistic Generalizations through Program Synthesis: Experiments with Phonology Problems ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Sample-efficient Linguistic Generalizations through Program Synthesis: Experiments with Phonology Problems ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Analyzing the Effects of Reasoning Types on Cross-Lingual Transfer Performance ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Predicting the Performance of Multilingual NLP Models ...
|
|
|
|
Abstract:
Recent advancements in NLP have given us models like mBERT and XLMR that can serve over 100 languages. The languages that these models are evaluated on, however, are very few in number, and it is unlikely that evaluation datasets will cover all the languages that these models support. Potential solutions to the costly problem of dataset creation are to translate datasets to new languages or use template-filling based techniques for creation. This paper proposes an alternate solution for evaluating a model across languages which make use of the existing performance scores of the model on languages that a particular task has test sets for. We train a predictor on these performance scores and use this predictor to predict the model's performance in different evaluation settings. Our results show that our method is effective in filling the gaps in the evaluation for an existing set of languages, but might require additional improvements if we want it to generalize to unseen languages. ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG
|
|
URL: https://arxiv.org/abs/2110.08875 https://dx.doi.org/10.48550/arxiv.2110.08875
|
|
BASE
|
|
Hide details
|
|
6 |
Designing Language Technologies for Social Good: The Road not Taken ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Use of Formal Ethical Reviews in {NLP} Literature: {H}istorical Trends and Current Practices ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
A New Dataset for Natural Language Inference from Code-mixed Conversations ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
The State and Fate of Linguistic Diversity and Inclusion in the NLP World ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Phone Merging for Code-switched Speech Recognition
|
|
|
|
In: Third Workshop on Computational Approaches to Linguistic Code-switching ; https://hal.inria.fr/hal-01800466 ; Third Workshop on Computational Approaches to Linguistic Code-switching, collocated with ACL 2018 Jul 2018, Melbourne, Australia (2018)
|
|
BASE
|
|
Show details
|
|
14 |
Is this word borrowed? An automatic approach to quantify the likeliness of borrowing in social media ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|