• Refine your search:
  • 
    Keyword:
    
    • Computation and Language cs.CL (4)
    • FOS Computer and information sciences (4)
    • Machine Learning cs.LG (2)
    • Machine Learning stat.ML (2)
    • Artificial Intelligence cs.AI (1)
    • Audio and Speech Processing eess.AS (1)
    • FOS Electrical engineering, electronic engineering, information engineering (1)
    • [INFO.INFO-CL]Computer Science [cs] / Computation and Language [cs.CL] (1)
  • 
    Creator / Publisher
  • 
    Year
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 7 of 7 1 Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets Caswell, Isaac; Kreutzer, Julia; Wang, Lisa... In: https://hal.inria.fr/hal-03177623 ; 2021 (2021) BASE Show details 2 Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets ... Kreutzer, Julia; Caswell, Isaac; Wang, Lisa. - : arXiv, 2021 BASE Show details 3 Transformers without Tears: Improving the Normalization of Self-Attention ... Nguyen, Toan Q.; Salazar, Julian. - : arXiv, 2019 BASE Show details 4 Transformers without Tears: Improving the Normalization of Self-Attention ... Nguyen, Toan Q.; Salazar, Julian. - : Zenodo, 2019 Abstract: We evaluate three simple, normalization-centric changes to improve Transformer training. First, we show that pre-norm residual connections (PRENORM) and smaller initializations enable warmup-free, validation-based training with large learning rates. Second, we propose l2 normalization with a single scale parameter (SCALENORM) for faster training and better performance. Finally, we reaffirm the effectiveness of normalizing word embeddings to a fixed length (FIXNORM). On five low-resource translation pairs from TED Talks-based corpora, these changes always converge, giving an average +1.1 BLEU over state-of-the-art bilingual baselines and a new 32.8 BLEU on IWSLT '15 English-Vietnamese. We ob- serve sharper performance curves, more consistent gradient norms, and a linear relationship between activation scaling and decoder depth. Surprisingly, in the high-resource setting (WMT '14 English-German), SCALENORM and FIXNORM remain competitive but PRENORM degrades performance. ... URL: https://dx.doi.org/10.5281/zenodo.3525484 https://zenodo.org/record/3525484 BASE Hide details 5 Transformers without Tears: Improving the Normalization of Self-Attention ... Nguyen, Toan Q.; Salazar, Julian. - : Zenodo, 2019 BASE Show details 6 Masked Language Model Scoring ... Salazar, Julian; Liang, Davis; Nguyen, Toan Q.. - : arXiv, 2019 BASE Show details 7 Improving Lexical Choice in Neural Machine Translation ... Nguyen, Toan Q.; Chiang, David. - : arXiv, 2017 BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 7 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0