DE eng

Search in the Catalogues and Directories

Hits 1 – 3 of 3

1
Fine-grained Factual Consistency Assessment for Abstractive Summarization Models ...
BASE
Show details
2
Explore Better Relative Position Embeddings from Encoding Perspective for Transformer Models ...
Abstract: Anthology paper link: https://aclanthology.org/2021.emnlp-main.237/ Abstract: Relative position embedding (RPE) is a successful method to explicitly and efficaciously encode position information into Transformer models. In this paper, we investigate the potential problems in Shaw-RPE and XL-RPE, which are the most representative and prevalent RPEs, and propose two novel RPEs called Low-level Fine-grained High-level Coarse-grained (LFHC) RPE and Gaussian Cumulative Distribution Function (GCDF) RPE. LFHC-RPE is an improvement of Shaw-RPE, which enhances the perception ability at medium and long relative positions. GCDF-RPE utilizes the excellent properties of the Gaussian function to amend the prior encoding mechanism in XL-RPE. Experimental results on nine authoritative datasets demonstrate the effectiveness of our methods empirically. Furthermore, GCDF-RPE achieves the best overall performance among five different RPEs. ...
Keyword: Computational Linguistics; Machine Learning; Machine Learning and Data Mining; Natural Language Processing
URL: https://underline.io/lecture/37334-explore-better-relative-position-embeddings-from-encoding-perspective-for-transformer-models
https://dx.doi.org/10.48448/8v7v-pc15
BASE
Hide details
3
Real-time query processing optimization for cloud-based wireless body area networks
In: Information sciences. - New York, NY : Elsevier Science Inc. 284 (2014), 84-94
OLC Linguistik
Show details

Catalogues
0
0
1
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
2
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern