DE eng

Search in the Catalogues and Directories

Hits 1 – 3 of 3

1
Simultaneous Speech Translation for Live Subtitling: from Delay to Display ...
BASE
Show details
2
Speechformer: Reducing Information Loss in Direct Speech Translation ...
BASE
Show details
3
Speechformer: Reducing Information Loss in Direct Speech Translation ...
Abstract: Anthology paper link: https://aclanthology.org/2021.emnlp-main.127/ Abstract: Transformer-based models have gained increasing popularity achieving state-of-the-art performance in many research fields including speech translation. However, Transformer's quadratic complexity with respect to the input sequence length prevents its adoption as is with audio signals, which are typically represented by long sequences. Current solutions resort to an initial sub-optimal compression based on a fixed sampling of raw audio features. Therefore, potentially useful linguistic information is not accessible to higher-level layers in the architecture. To solve this issue, we propose Speechformer, an architecture that, thanks to reduced memory usage in the attention layers, avoids the initial lossy compression and aggregates information only at a higher level according to more informed linguistic criteria. Experiments on three language pairs (en->de/es/nl) show the efficacy of our solution, with gains of up to 0.8 BLEU on ...
Keyword: Computational Linguistics; Machine Learning; Machine Learning and Data Mining; Machine translation; Natural Language Processing
URL: https://underline.io/lecture/37646-speechformer-reducing-information-loss-in-direct-speech-translation
https://dx.doi.org/10.48448/r8cv-6f19
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
3
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern