1 |
Structural, Functional, and Processing Perspectives on Linguistic Island Effects
|
|
|
|
In: EISSN: 2333-9691 ; Annual Review of Linguistics ; https://hal.archives-ouvertes.fr/hal-03506510 ; Annual Review of Linguistics, Annual Reviews, 2022, 8 (1), ⟨10.1146/annurev-linguistics-011619-030319⟩ (2022)
|
|
BASE
|
|
Show details
|
|
2 |
Universal Conditional Masked Language Pre-training for Neural Machine Translation ...
|
|
|
|
Abstract:
Pre-trained sequence-to-sequence models have significantly improved Neural Machine Translation (NMT). Different from prior works where pre-trained models usually adopt an unidirectional decoder, this paper demonstrates that pre-training a sequence-to-sequence model but with a bidirectional decoder can produce notable performance gains for both Autoregressive and Non-autoregressive NMT. Specifically, we propose CeMAT, a conditional masked language model pre-trained on large-scale bilingual and monolingual corpora in many languages. We also introduce two simple but effective methods to enhance the CeMAT, aligned code-switching & masking and dynamic dual-masking. We conduct extensive experiments and show that our CeMAT can achieve significant performance improvement for all scenarios from low- to extremely high-resource languages, i.e., up to +14.4 BLEU on low resource and +7.9 BLEU improvements on average for Autoregressive NMT. For Non-autoregressive NMT, we demonstrate it can also produce consistent ... : Accepted to ACL 2022 Main conference ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2203.09210 https://arxiv.org/abs/2203.09210
|
|
BASE
|
|
Hide details
|
|
3 |
Conditional Bilingual Mutual Information Based Adaptive Training for Neural Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Entropy Analysis of Heart Rate Variability in Different Sleep Stages
|
|
|
|
In: Entropy; Volume 24; Issue 3; Pages: 379 (2022)
|
|
BASE
|
|
Show details
|
|
6 |
A verb-frame frequency account of constraints on long-distance dependencies in English
|
|
|
|
In: Prof. Gibson (2022)
|
|
BASE
|
|
Show details
|
|
7 |
Towards Contextual Spelling Correction for Customization of End-to-end Speech Recognition Systems ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Bridging Video-text Retrieval with Multiple Choice Questions ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
The Past Mistake is the Future Wisdom: Error-driven Contrastive Probability Optimization for Chinese Spell Checking ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Hierarchical Softmax for End-to-End Low-resource Multilingual Speech Recognition ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Sememe Prediction for BabelNet Synsets using Multilingual and Multimodal Information ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
USTC-NELSLIP at SemEval-2022 Task 11: Gazetteer-Adapted Integration Network for Multilingual Complex Named Entity Recognition ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Implementation of multilingual support of the European Multicenter Study about Spinal Cord Injury (EMSCI) ISNCSCI calculator ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
Delving Deeper into Cross-lingual Visual Question Answering ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Zero-shot Cross-lingual Conversational Semantic Role Labeling ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Multi-Level Contrastive Learning for Cross-Lingual Alignment ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognition ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|