1 |
BERTGEN: Multi-task Generation through BERT ...
|
|
|
|
Abstract:
We present BERTGEN, a novel generative, decoder-only model which extends BERT by fusing multimodal and multilingual pretrained models VL-BERT and M-BERT, respectively. BERTGEN is auto-regressively trained for language generation tasks, namely image captioning, machine translation and multimodal machine translation, under a multitask setting. With a comprehensive set of evaluations, we show that BERTGEN outperforms many strong baselines across the tasks explored. We also show BERTGEN's ability for zero-shot language generation, where it exhibits competitive performance to supervised counterparts. Finally, we conduct ablation studies which demonstrate that BERTGEN substantially benefits from multi-tasking and effectively transfers relevant inductive biases from the pre-trained models. ... : Accepted to ACL 2021 Main Conference ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2106.03484 https://dx.doi.org/10.48550/arxiv.2106.03484
|
|
BASE
|
|
Hide details
|
|
3 |
MSVD-Turkish: A Comprehensive Multimodal Dataset for Integrated Vision and Language Research in Turkish ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Multimodal Machine Translation ; Traduction Automatique Multimodale
|
|
|
|
In: https://tel.archives-ouvertes.fr/tel-02309868 ; Computation and Language [cs.CL]. Le Mans Université, 2019. English. ⟨NNT : 2019LEMA1016⟩ (2019)
|
|
BASE
|
|
Show details
|
|
6 |
NMTPY: A Flexible Toolkit for Advanced Neural Machine Translation Systems
|
|
|
|
In: ISSN: 1804-0462 ; The Prague Bulletin of Mathematical Linguistics ; https://hal-univ-lemans.archives-ouvertes.fr/hal-01647873 ; The Prague Bulletin of Mathematical Linguistics, Univerzita Karlova v Praze, 2017, 109 (1), ⟨10.1515/pralin-2017-0035⟩ (2017)
|
|
BASE
|
|
Show details
|
|
7 |
NMTPY: A Flexible Toolkit for Advanced Neural Machine Translation Systems
|
|
|
|
In: Prague Bulletin of Mathematical Linguistics , Vol 109, Iss 1, Pp 15-28 (2017) (2017)
|
|
BASE
|
|
Show details
|
|
|
|