1 |
The puzzling nuanced status of who free relative clauses in English: a follow-up to Patterson and Caponigro (2015)
|
|
|
|
In: ENGLISH LANGUAGE & LINGUISTICS, vol 26, iss 1 (2022)
|
|
BASE
|
|
Show details
|
|
2 |
Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost
|
|
|
|
In: ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-03613101 ; ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics, May 2022, Dublin, Ireland (2022)
|
|
Abstract:
International audience ; State-of-the-art NLP systems represent inputs with word embeddings, but these are brittle when faced with Out-of-Vocabulary (OOV) words. To address this issue, we follow the principle of mimick-like models to generate vectors for unseen words, by learning the behavior of pre-trained embeddings using only the surface form of words. We present a simple contrastive learning framework, LOVE, which extends the word representation of an existing pre-trained language model (such as BERT), and makes it robust to OOV with few additional parameters. Extensive evaluations demonstrate that our lightweight model achieves similar or even better performances than prior competitors, both on original datasets and on corrupted variants. Moreover, it can be used in a plug-and-play fashion with FastText and BERT, where it significantly improves their robustness.
|
|
Keyword:
[INFO.INFO-AI]Computer Science [cs]/Artificial Intelligence [cs.AI]; Language models; Out-of-vocabulary OOV words; Word embeddings
|
|
URL: https://hal.archives-ouvertes.fr/hal-03613101/file/OOV_Problem.pdf https://hal.archives-ouvertes.fr/hal-03613101 https://hal.archives-ouvertes.fr/hal-03613101/document
|
|
BASE
|
|
Hide details
|
|
3 |
Imputing out-of-vocabulary embeddings with LOVE makes language models robust with little cost
|
|
|
|
In: ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-03613101 ; ACL 2022 - 60th Annual Meeting of the Association for Computational Linguistics, May 2022, Dublin, Ireland (2022)
|
|
BASE
|
|
Show details
|
|
4 |
THE ROLE OF WH- QUESTIONS IN TEACHING SPEAKING SKILLS AT SCHOOL ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
THE ROLE OF WH- QUESTIONS IN TEACHING SPEAKING SKILLS AT SCHOOL ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
СЕМАНТИЧЕСКИЕ ЗАИМСТВОВАНИЯ (ИССЛЕДОВАНИЕ КИТАЙСКИХ ЗАИМСТВОВАНИЙ СЕНСОРНО-ПЕРЦЕПТИВНОЙ КАТЕГОРИИ) ... : SEMANTIC BORROWINGS (A STUDY OF CHINESE BORROWINGS OF THE SENSORY-PERCEPTUAL CATEGORY) ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
ENLIGHTENMENT-MORAL, PHILOSOPHICAL, LINGUISTIC VIEWS OF MODERN CREATORS ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
ENLIGHTENMENT-MORAL, PHILOSOPHICAL, LINGUISTIC VIEWS OF MODERN CREATORS ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
SOME REVIEWS ABOUT THE PARALINGUISTIC MODE - ПАРАЛИНГВИСТИК МОДУС ХУСУСИДА БАЪЗИ МУЛОҲАЗАЛАР ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
SOME REVIEWS ABOUT THE PARALINGUISTIC MODE - ПАРАЛИНГВИСТИК МОДУС ХУСУСИДА БАЪЗИ МУЛОҲАЗАЛАР ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
ERKIN VOHIDOV DOSTONLARINING FONETIK-FONOLOGIK XUSUSIYATLARI ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
О ФУНКЦИИ ОТНОСИТЕЛЬНЫХ СЛОВ В СЛОЖНОМ СИНТАКСИЧЕСКОМ ЦЕЛОМ ... : ON THE FUNCTION OF RELATIVE WORDS IN A COMPLEX SYNTACTIC WHOLE ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
American Sign Language Words Recognition of Skeletal Videos Using Processed Video Driven Multi-Stacked Deep LSTM
|
|
|
|
In: Sensors; Volume 22; Issue 4; Pages: 1406 (2022)
|
|
BASE
|
|
Show details
|
|
19 |
ポライトネス・ストラテジーとしての書面語表現 : レアリアによる中国語教育の一環として(6) ; A Study on Written Expressions as Politeness Strategies in Chinese Language
|
|
|
|
BASE
|
|
Show details
|
|
20 |
ON THE THRESHOLD OF THE THIRD REVIVAL ANALYSIS OF THE PRACTICAL DEVELOPMENT OF THE UZBEK LANGUAGE ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|