Home
Catalogue search
Refine your search:
Keyword:
Computation and Language cs.CL (2)
FOS Computer and information sciences (2)
Computational Linguistics (1)
I.2.7 (1)
Machine Learning cs.LG (1)
animacy (1)
ergativity (1)
interpretability (1)
mBERT (1)
morphosyntax (1)
more
Creator / Publisher:
Chi, Ethan A. (4)
Futrell, Richard (3)
Mahowald, Kyle (3)
Papadimitriou, Isabel (3)
Hewitt, John (1)
Manning, Christopher D. (1)
Year
Medium:
Online (4)
Type
BLLDB-Access:
free (4)
subject to license (0)
Search in the Catalogues and Directories
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
Sort by
creator [A → Z]
'
creator [Z → A]
'
publishing year ↑ (asc)
'
publishing year ↓ (desc)
'
title [A → Z]
'
title [Z → A]
'
Simple Search
Hits 1 – 4 of 4
1
Deep Subjecthood: Higher-Order Grammatical Features in Multilingual BERT ...
Papadimitriou, Isabel
;
Chi, Ethan A.
;
Futrell, Richard
. - : arXiv, 2021
BASE
Show details
2
Multilingual BERT, Ergativity, and Grammatical Subjecthood ...
Papadimitriou, Isabel
;
Chi, Ethan A.
;
Futrell, Richard
. - : University of Massachusetts Amherst, 2021
BASE
Show details
3
Multilingual BERT, Ergativity, and Grammatical Subjecthood
Papadimitriou, Isabel
;
Chi, Ethan A.
;
Futrell, Richard
;
Mahowald, Kyle
In: Proceedings of the Society for Computation in Linguistics (2021)
Abstract:
We investigate how Multilingual BERT (mBERT) encodes grammar by examining how the high-order grammatical feature of morphosyntactic alignment (how different languages define what counts as a "subject") is manifested across the embedding spaces of different languages. To understand if and how morphosyntactic alignment affects contextual embedding spaces, we train classifiers to recover the subjecthood of mBERT embeddings in transitive sentences (which do not contain overt information about morphosyntactic alignment) and then evaluate them zero-shot on intransitive sentences (where subjecthood classification depends on alignment), within and across languages. We find that the resulting classifier distributions reflect the morphosyntactic alignment of their training languages. Our results demonstrate that mBERT representations are influenced by high-level grammatical features that are not manifested in any one input sentence, and that this is robust across languages. Further examining the characteristics that our classifiers rely on, we find that features such as passive voice, animacy and case strongly correlate with classification decisions, suggesting that mBERT does not encode a purely syntactic subjecthood, but a continuous subjecthood as is proposed in much of the functional linguistics literature. Together, these results provide insight into how grammatical features manifest in contextual embedding spaces, at a level of abstraction not covered by previous work.
Keyword:
animacy
;
Computational Linguistics
;
ergativity
;
interpretability
;
mBERT
;
morphosyntax
;
transformers
URL:
https://scholarworks.umass.edu/scil/vol4/iss1/51
https://scholarworks.umass.edu/cgi/viewcontent.cgi?article=1220&context=scil
BASE
Hide details
4
Finding Universal Grammatical Relations in Multilingual BERT ...
Chi, Ethan A.
;
Hewitt, John
;
Manning, Christopher D.
. - : arXiv, 2020
BASE
Show details
Mobile view
All
Catalogues
UB Frankfurt Linguistik
0
IDS Mannheim
0
OLC Linguistik
0
UB Frankfurt Retrokatalog
0
DNB Subject Category Language
0
Institut für Empirische Sprachwissenschaft
0
Leibniz-Centre General Linguistics (ZAS)
0
Bibliographies
BLLDB
0
BDSL
0
IDS Bibliografie zur deutschen Grammatik
0
IDS Bibliografie zur Gesprächsforschung
0
IDS Konnektoren im Deutschen
0
IDS Präpositionen im Deutschen
0
IDS OBELEX meta
0
MPI-SHH Linguistics Collection
0
MPI for Psycholinguistics
0
Linked Open Data catalogues
Annohub
0
Online resources
Link directory
0
Journal directory
0
Database directory
0
Dictionary directory
0
Open access documents
BASE
4
Linguistik-Repository
0
IDS Publikationsserver
0
Online dissertations
0
Language Description Heritage
0
© 2013 - 2024 Lin|gu|is|tik
|
Imprint
|
Privacy Policy
|
Datenschutzeinstellungen ändern