• Refine your search:
  • 
    Keyword:
    
    • Computation and Language cs.CL (3)
    • FOS Computer and information sciences (3)
    • Computational Linguistics (1)
    • Condensed Matter Physics (1)
    • Deep Learning (1)
    • Electromagnetism (1)
    • FOS Physical sciences (1)
    • Information and Knowledge Engineering (1)
    • Machine Learning cs.LG (1)
    • Machine Learning stat.ML (1)
    •   more
  • 
    Creator / Publisher
  • 
    Year:
    
    • 2021 (1)
    • 2019 (1)
    • 2018 (2)
  • 
    Medium
  • 
    Type:
    
    • Miscellaneous (3)
    • Article (1)
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 4 of 4 1 Exploring Unsupervised Pretraining Objectives for Machine Translation ... The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021; Baziotis, Christos; Birch, Alexandra; Haddo, Barry; Titov, Ivan. - : Underline Science Inc., 2021 Abstract: Read paper: https://www.aclanthology.org/2021.findings-acl.261 Abstract: Unsupervised cross-lingual pretraining has achieved strong results in neural machine translation (NMT), by drastically reducing the need for large parallel data. Most approaches adapt masked-language modeling (MLM) to sequence-to-sequence architectures, by masking parts of the input and reconstructing them in the decoder. In this work, we systematically compare masking with alternative objectives that produce inputs resembling real (full) sentences, by reordering and replacing words based on their context. We pretrain models with different methods on English-German, English-Nepali and English-Sinhala monolingual data, and evaluate them on NMT, obtaining very unexpected results. In (semi-) supervised NMT, varying the pretraining objective leads to surprisingly small differences in the finetuned performance, whereas unsupervised NMT is much more sensitive to it. To understand these results, we thoroughly study the pretrained models using ... Keyword: Computational Linguistics; Condensed Matter Physics; Deep Learning; Electromagnetism; FOS Physical sciences; Information and Knowledge Engineering; Neural Network; Semantics URL: https://underline.io/lecture/26352-exploring-unsupervised-pretraining-objectives-for-machine-translation https://dx.doi.org/10.48448/f0pt-cb53 BASE Hide details 2 Attention-based Conditioning Methods for External Knowledge Integration ... Margatina, Katerina; Baziotis, Christos; Potamianos, Alexandros. - : arXiv, 2019 BASE Show details 3 NTUA-SLP at SemEval-2018 Task 2: Predicting Emojis using RNNs with Context-aware Attention ... Baziotis, Christos; Athanasiou, Nikos; Paraskevopoulos, Georgios. - : arXiv, 2018 BASE Show details 4 NTUA-SLP at SemEval-2018 Task 3: Tracking Ironic Tweets using Ensembles of Word and Character Level Attentive RNNs ... Baziotis, Christos; Athanasiou, Nikos; Papalampidi, Pinelopi. - : arXiv, 2018 BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 4 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0