3 |
What's in a Span? Evaluating the Creativity of a Span-Based Neural Constituency Parser
|
|
|
|
In: Proceedings of the Society for Computation in Linguistics (2021)
|
|
Abstract:
Constituency parsing is generally evaluated superficially, particularly in a multiple language setting, with only F-scores being re-ported. As new state-of-the-art chart-based parsers have resulted in a transition from traditional PCFG-based grammars to span-based approaches (Stern et al., 2017; Gaddy et al.,2018), we do not have a good understanding of how such fundamentally different approaches interact with various treebanks as results show improvements across treebanks (Kitaev and Klein, 2018), but it is unclear what influence annotation schemes have on various treebank performance (Kitaev et al., 2019). In particular, a span-based parser’s capability of creating novel rules is an unknown factor. We perform an analysis of how span-based parsing performs across 11 treebanks in order to examine the overall behavior of this parsing approach and the effect of the treebanks’ specific annotations on results. We find that the parser tends to prefer flatter trees, but the approach works well because it is robust enough to adapt to differences in annotation schemes across treebanks and languages.
|
|
Keyword:
Computational Linguistics; error analysis; evaluation; multilingual setting; neural constituency parsing; span-based parsing
|
|
URL: https://scholarworks.umass.edu/scil/vol4/iss1/35 https://scholarworks.umass.edu/cgi/viewcontent.cgi?article=1172&context=scil
|
|
BASE
|
|
Hide details
|
|
5 |
MonaLog: a Lightweight System for Natural Language Inference Based on Monotonicity
|
|
|
|
In: Proceedings of the Society for Computation in Linguistics (2020)
|
|
BASE
|
|
Show details
|
|
7 |
MonaLog: a Lightweight System for Natural Language Inference Based on Monotonicity ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Sentiment Annotation of Historic German Plays: An Empirical Study on Annotation Behavior
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Sentiment Annotation of Historic German Plays: An Empirical Study on Annotation Behavior
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Morphological features of the Irish universal dependency treebank
|
|
|
|
In: Lynn, Teresa, Foster, Jennifer orcid:0000-0002-7789-4853 and Dras, Mark (2017) Morphological features of the Irish universal dependency treebank. In: 15th International Workshop on Treebanks and Linguistic Theories (TLT15), 20-21 Jan 2017, Bloomington, IN, USA. (2017)
|
|
BASE
|
|
Show details
|
|
|
|