DE eng

Search in the Catalogues and Directories

Page: 1 2
Hits 1 – 20 of 35

1
When Classifying Arguments, BERT Doesn't Care About Word Order. Except When It Matters
In: Proceedings of the Society for Computation in Linguistics (2022)
Abstract: We probe nouns in BERT contextual embedding space for grammatical role (subject vs. object of a clause), and examine how probing results vary between prototypical examples, where the role matches what we would expect from seeing that word in the context, and non-prototypical examples, where the role is mostly imparted by the context. In this way, engage with the contrast that has arisen in the literature, between studies that show contextual models as grammatically sensitive, and others that show that these models are robust to changes in word order. Our experiments yield three results: 1) Grammatical role is recovered in later layers for difficult non-prototypical cases, while prototypical cases are accurate without many layers of context 2) When we switch the subject and the object of a sentence around (eg, The chef cut the onion, The onion cut the chef), we see that the same word (eg, onion) can be fluently identified as both a subject and an object 3) Subjecthood probing breaks if we ablate local word order by shuffle words locally and break grammaticality.
Keyword: BERT; Computational Linguistics; Contextual embeddings; grammatical role; prototype; subjecthood; verb arguments; word order
URL: https://scholarworks.umass.edu/scil/vol5/iss1/18
https://scholarworks.umass.edu/cgi/viewcontent.cgi?article=1244&context=scil
BASE
Hide details
2
Efficient communication and the organization of the lexicon
In: OUP volume on the Mental Lexicon ; https://hal.archives-ouvertes.fr/hal-03482414 ; OUP volume on the Mental Lexicon, In press, ⟨10.31234/osf.io/4an6v⟩ (2021)
BASE
Show details
3
Multilingual BERT, Ergativity, and Grammatical Subjecthood ...
Papadimitriou, Isabel; Chi, Ethan A.; Futrell, Richard. - : University of Massachusetts Amherst, 2021
BASE
Show details
4
Decrypting cryptic crosswords: Semantically complex wordplay puzzles as a target for NLP ...
BASE
Show details
5
Decrypting cryptic crosswords: Semantically complex wordplay puzzles as a target for NLP ...
BASE
Show details
6
Decrypting cryptic crosswords: Semantically complex wordplay puzzles as a target for NLP ...
BASE
Show details
7
Decrypting cryptic crosswords: Semantically complex wordplay puzzles as a target for NLP ...
BASE
Show details
8
Decrypting cryptic crosswords: Semantically complex wordplay puzzles as a target for NLP ...
BASE
Show details
9
A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Space ...
BASE
Show details
10
REPLICATING A FUNDAMENTAL FINDING IN PSYCHOLINGUISTICS: SYNTACTIC PRIMING ...
Mahowald, Kyle. - : Open Science Framework, 2021
BASE
Show details
11
How (Non-)Optimal is the Lexicon?
In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (2021)
BASE
Show details
12
How (Non-)Optimal is the Lexicon? ...
NAACL 2021 2021; Blasi, Damián; Cotterell, Ryan. - : Underline Science Inc., 2021
BASE
Show details
13
How (Non-)Optimal is the Lexicon? ...
BASE
Show details
14
Multilingual BERT, Ergativity, and Grammatical Subjecthood
In: Proceedings of the Society for Computation in Linguistics (2021)
BASE
Show details
15
Concord begets concord: A Bayesian model of nominal concord typology
In: Proceedings of the Linguistic Society of America; Vol 6, No 1 (2021): Proceedings of the Linguistic Society of America; 541–555 ; 2473-8689 (2021)
BASE
Show details
16
How Efficiency Shapes Human Language ; How Efficiency Shapes Human Language, TICS 2019
In: Prof. Levy via Courtney Crummett (2019)
BASE
Show details
17
Word Forms Are Structured for Efficient Use
In: ISSN: 0364-0213 ; EISSN: 1551-6709 ; Cognitive Science ; https://hal.archives-ouvertes.fr/hal-03552561 ; Cognitive Science, Wiley, 2018, 42 (8), pp.3116-3134. ⟨10.1111/cogs.12689⟩ (2018)
BASE
Show details
18
Word Forms Are Structured for Efficient Use
In: Prof. Gibson via Courtney Crummett (2018)
BASE
Show details
19
Color naming across languages reflects color use
In: National Academy of Sciences (2018)
BASE
Show details
20
SNAP judgments: A small N acceptability paradigm (SNAP) for linguistic acceptability judgments: Online Appendices
In: Language (2018)
BASE
Show details

Page: 1 2

Catalogues
0
0
2
0
0
0
0
Bibliographies
2
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
33
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern