| 3 |
Registerial Adaptation vs. Innovation Across Situational Contexts: 18th Century Women in Transition
|
|
|
|
In: Front Artif Intell (2021)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 6 |
A Closer Look at Linguistic Knowledge in Masked Language Models: The Case of Relative Clauses in American English ...
|
|
|
|
Abstract:
Transformer-based language models achieve high performance on various tasks, but we still lack understanding of the kind of linguistic knowledge they learn and rely on. We evaluate three models (BERT, RoBERTa, and ALBERT), testing their grammatical and semantic knowledge by sentence-level probing, diagnostic cases, and masked prediction tasks. We focus on relative clauses (in American English) as a complex phenomenon needing contextual information and antecedent identification to be resolved. Based on a naturalistic dataset, probing shows that all three models indeed capture linguistic knowledge about grammaticality, achieving high performance.Evaluation on diagnostic cases and masked prediction tasks considering fine-grained linguistic knowledge, however, shows pronounced model-specific weaknesses especially on semantic knowledge, strongly impacting models’ performance. Our results highlight the importance of (a)model comparison in evaluation task and (b) building up claims of model performance and the ...
|
|
Keyword:
Computer and Information Science; Natural Language Processing; Neural Network
|
|
URL: https://dx.doi.org/10.48448/xwge-6p50
https://underline.io/lecture/6358-a-closer-look-at-linguistic-knowledge-in-masked-language-models-the-case-of-relative-clauses-in-american-english
|
|
BASE
|
|
Hide details
|
|
|
| 7 |
Linguistic Variation and Change in 250 Years of English Scientific Writing: A Data-Driven Approach
|
|
|
|
In: Front Artif Intell (2020)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Evaluative meaning in scientific writing : macro- and micro-analytic perspectives using data mining
|
|
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Data Mining with Shallow vs. Linguistic Features to Study Diversification of Scientific Registers [Online resource]
|
|
|
|
IDS-Repository
|
|
Show details
|
|
|
| 14 |
Linguistic Variation and Change in 250 Years of English Scientific Writing: A Data-Driven Approach [Online resource]
|
|
|
|
IDS-Repository
|
|
Show details
|
|
|
| 15 |
Less is more/more diverse: On the communicative utility of linguistic conventionalization [Online resource]
|
|
|
|
IDS-Repository
|
|
Show details
|
|
|
|
|
