Home
Catalogue search
Refine your search:
Keyword
Creator / Publisher:
Feng, Shikun (4)
Liu, Jiaxiang (4)
Sun, Yu (4)
Chen, Li (2)
Chen, Xuyi (2)
Feng, Zhida (2)
Ouyang, Xuan (2)
Tang, Jiji (2)
The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021 (2)
Wang, Shuohuan (2)
more
Year
Medium
Type
BLLDB-Access
Search in the Catalogues and Directories
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
Sort by
creator [A → Z]
'
creator [Z → A]
'
publishing year ↑ (asc)
'
publishing year ↓ (desc)
'
title [A → Z]
'
title [Z → A]
'
Simple Search
Hits 1 – 4 of 4
1
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation ...
Sun, Yu
;
Wang, Shuohuan
;
Feng, Shikun
;
Ding, Siyu
;
Pang, Chao
;
Shang, Junyuan
;
Liu, Jiaxiang
;
Chen, Xuyi
;
Zhao, Yanbin
;
Lu, Yuxiang
;
Liu, Weixin
;
Wu, Zhihua
;
Gong, Weibao
;
Liang, Jianzhong
;
Shang, Zhizhou
;
Sun, Peng
;
Liu, Wei
;
Ouyang, Xuan
;
Yu, Dianhai
;
Tian, Hao
;
Wu, Hua
;
Wang, Haifeng
. - : arXiv, 2021
Abstract:
Pre-trained models have achieved state-of-the-art results in various Natural Language Processing (NLP) tasks. Recent works such as T5 and GPT-3 have shown that scaling up pre-trained language models can improve their generalization abilities. Particularly, the GPT-3 model with 175 billion parameters shows its strong task-agnostic zero-shot/few-shot learning capabilities. Despite their success, these large-scale models are trained on plain texts without introducing knowledge such as linguistic knowledge and world knowledge. In addition, most large-scale models are trained in an auto-regressive way. As a result, this kind of traditional fine-tuning approach demonstrates relatively weak performance when solving downstream language understanding tasks. In order to solve the above problems, we propose a unified framework named ERNIE 3.0 for pre-training large-scale knowledge enhanced models. It fuses auto-regressive network and auto-encoding network, so that the trained model can be easily tailored for both ...
Keyword:
Computation and Language cs.CL
;
FOS Computer and information sciences
URL:
https://arxiv.org/abs/2107.02137
https://dx.doi.org/10.48550/arxiv.2107.02137
BASE
Hide details
2
Alpha at SemEval-2021 Tasks 6: Transformer Based Propaganda Classification ...
The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021
;
Chen, Li
;
Feng, Zhida
. - : Underline Science Inc., 2021
BASE
Show details
3
Alpha at SemEval-2021 Tasks 6: Transformer Based Propaganda Classification ...
The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing 2021
;
Chen, Li
;
Feng, Zhida
. - : Underline Science Inc., 2021
BASE
Show details
4
kk2018 at SemEval-2020 Task 9: Adversarial Training for Code-Mixing Sentiment Classification ...
Liu, Jiaxiang
;
Chen, Xuyi
;
Feng, Shikun
. - : arXiv, 2020
BASE
Show details
Mobile view
All
Catalogues
UB Frankfurt Linguistik
0
IDS Mannheim
0
OLC Linguistik
0
UB Frankfurt Retrokatalog
0
DNB Subject Category Language
0
Institut für Empirische Sprachwissenschaft
0
Leibniz-Centre General Linguistics (ZAS)
0
Bibliographies
BLLDB
0
BDSL
0
IDS Bibliografie zur deutschen Grammatik
0
IDS Bibliografie zur Gesprächsforschung
0
IDS Konnektoren im Deutschen
0
IDS Präpositionen im Deutschen
0
IDS OBELEX meta
0
MPI-SHH Linguistics Collection
0
MPI for Psycholinguistics
0
Linked Open Data catalogues
Annohub
0
Online resources
Link directory
0
Journal directory
0
Database directory
0
Dictionary directory
0
Open access documents
BASE
4
Linguistik-Repository
0
IDS Publikationsserver
0
Online dissertations
0
Language Description Heritage
0
© 2013 - 2024 Lin|gu|is|tik
|
Imprint
|
Privacy Policy
|
Datenschutzeinstellungen ändern