DE eng

Search in the Catalogues and Directories

Hits 1 – 14 of 14

1
Lightweight Cross-Lingual Sentence Representation Learning ...
Abstract: Read paper: https://www.aclanthology.org/2021.acl-long.226 Abstract: Large-scale models for learning fixed-dimensional cross-lingual sentence representations like Large-scale models for learning fixed-dimensional cross-lingual sentence representations like LASER (Artetxe and Schwenk, 2019b) lead to significant improvement in performance on downstream tasks. However, further increases and modifications based on such large-scale models are usually impractical due to memory limitations. In this work, we introduce a lightweight dual-transformer architecture with just 2 layers for generating memory-efficient cross-lingual sentence representations. We explore different training tasks and observe that current cross-lingual training tasks leave a lot to be desired for this shallow architecture. To ameliorate this, we propose a novel cross-lingual language model, which combines the existing single-word masked language model with the newly proposed cross-lingual token-level reconstruction task. We further augment the ...
Keyword: Computational Linguistics; Condensed Matter Physics; Deep Learning; Electromagnetism; FOS Physical sciences; Information and Knowledge Engineering; Neural Network; Semantics
URL: https://underline.io/lecture/25556-lightweight-cross-lingual-sentence-representation-learning
https://dx.doi.org/10.48448/gqz9-a976
BASE
Hide details
2
Obtaining Better Static Word Embeddings Using Contextual Embedding Models ...
Gupta, Prakhar; Jaggi, Martin. - : arXiv, 2021
BASE
Show details
3
Obtaining Better Static Word Embeddings Using Contextual Embedding Models ...
BASE
Show details
4
Correlating Twitter Language with Community-Level Health Outcomes
In: http://infoscience.epfl.ch/record/278185 (2020)
BASE
Show details
5
Robust Cross-lingual Embeddings from Parallel Sentences ...
BASE
Show details
6
Crosslingual Document Embedding as Reduced-Rank Ridge Regression ...
BASE
Show details
7
System-Aware Algorithms For Machine Learning
Mendler-Dünner, Celestine. - : ETH Zurich, 2019
BASE
Show details
8
Crosslingual Document Embedding as Reduced-Rank Ridge Regression
In: http://infoscience.epfl.ch/record/263893 (2019)
BASE
Show details
9
Leveraging Large Amounts of Weakly Supervised Data for Multi-Language Sentiment Classification ...
BASE
Show details
10
Generating Steganographic Text with LSTMs ...
BASE
Show details
11
Leveraging large amounts of weakly supervised data for multi-language sentiment classification ...
BASE
Show details
12
Leveraging large amounts of weakly supervised data for multi-language sentiment classification ...
BASE
Show details
13
Generating Steganographic Text with LSTMs
In: http://infoscience.epfl.ch/record/229881 (2017)
BASE
Show details
14
Swiss-chocolate : sentiment detection using sparse SVMs and part-of-speech n-grams ...
Jaggi, Martin; Uzdilli, Fatih; Cieliebak, Mark. - : Association for Computational Linguistics, 2014
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
14
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern