1 |
SMDT: Selective Memory-Augmented Neural Document Translation ...
|
|
|
|
Abstract:
Existing document-level neural machine translation (NMT) models have sufficiently explored different context settings to provide guidance for target generation. However, little attention is paid to inaugurate more diverse context for abundant context information. In this paper, we propose a Selective Memory-augmented Neural Document Translation model to deal with documents containing large hypothesis space of the context. Specifically, we retrieve similar bilingual sentence pairs from the training corpus to augment global context and then extend the two-stream attention model with selective mechanism to capture local context and diverse global contexts. This unified approach allows our model to be trained elegantly on three publicly document-level machine translation datasets and significantly outperforms previous document-level NMT models. ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://dx.doi.org/10.48550/arxiv.2201.01631 https://arxiv.org/abs/2201.01631
|
|
BASE
|
|
Hide details
|
|
2 |
StableMoE: Stable Routing Strategy for Mixture of Experts ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
On the Representation Collapse of Sparse Mixture of Experts ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
How Does Distilled Data Complexity Impact the Quality and Confidence of Non-Autoregressive Machine Translation? ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Deconvolution-Based Global Decoding for Neural Machine Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
A Semantic Relevance Based Neural Network for Text Summarization and Text Simplification ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|