DE eng

Search in the Catalogues and Directories

Hits 1 – 5 of 5

1
Visualizing Cross-Lingual Discourse Relations in Multilingual TED Corpora
In: Proceedings of the 2nd Workshop on Computational Approaches to Discourse ; CODI 2021: 2nd Workshop on Computational Approaches to Discourse ; https://hal.archives-ouvertes.fr/hal-03642341 ; CODI 2021: 2nd Workshop on Computational Approaches to Discourse, Nov 2021, Punta Cana, Dominican Republic. ⟨10.18653/v1/2021.codi-main.16⟩ (2021)
BASE
Show details
2
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads?
In: Findings of ACL 2021 ; https://hal.archives-ouvertes.fr/hal-03299010 ; Findings of ACL 2021, Aug 2021, Bangkok (virtual), Thailand (2021)
BASE
Show details
3
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads? ...
BASE
Show details
4
Do Multilingual Neural Machine Translation Models Contain Language Pair Specific Attention Heads? ...
Abstract: Read paper: https://www.aclanthology.org/2021.findings-acl.250 Abstract: Recent studies on the analysis of the multilingual representations focus on identifying whether there is an emergence of language-independent representations, or whether a multilingual model partitions its weights among different languages. While most of such work has been conducted in a "black-box" manner, this paper aims to analyze individual components of a multilingual neural translation (NMT) model. In particular, we look at the encoder self-attention and encoder-decoder attention heads (in a many-to-one NMT model) that are more specific to the translation of a certain language pair than others by (1) employing metrics that quantify some aspects of the attention weights such as "variance" or "confidence", and (2) systematically ranking the importance of attention heads with respect to translation quality. Experimental results show that surprisingly, the set of most important attention heads are very similar across the language ...
Keyword: Computational Linguistics; Condensed Matter Physics; Deep Learning; Electromagnetism; FOS Physical sciences; Information and Knowledge Engineering; Neural Network; Semantics
URL: https://underline.io/lecture/26341-do-multilingual-neural-machine-translation-models-contain-language-pair-specific-attention-headsquestion
https://dx.doi.org/10.48448/dbyw-2r96
BASE
Hide details
5
A Multilingual Neural Machine Translation Model for Biomedical Data ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
5
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern