1 |
Evaluating Document Coherence Modelling ...
|
|
|
|
Abstract:
While pretrained language models ("LM") have driven impressive gains over morpho-syntactic and semantic tasks, their ability to model discourse and pragmatic phenomena is less clear. As a step towards a better understanding of their discourse modelling capabilities, we propose a sentence intrusion detection task. We examine the performance of a broad range of pretrained LMs on this detection task for English. Lacking a dataset for the task, we introduce INSteD, a novel intruder sentence detection dataset, containing 170,000+ documents constructed from English Wikipedia and CNN news articles. Our experiments show that pretrained LMs perform impressively in in-domain evaluation, but experience a substantial drop in the cross-domain setting, indicating limited generalisation capacity. Further results over a novel linguistic probe dataset show that there is substantial room for improvement, especially in the cross-domain setting. ... : accepted to TACL 2021 ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2103.10133 https://dx.doi.org/10.48550/arxiv.2103.10133
|
|
BASE
|
|
Hide details
|
|
2 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
3 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
4 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
5 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
6 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
7 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
8 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
9 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
10 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
11 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
12 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
13 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
14 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
15 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
16 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
17 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
18 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
19 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
20 |
Multiword expressions at length and in depth: Extended papers from the MWE 2017 workshop
|
|
|
|
In: Language Science Press; (2018)
|
|
BASE
|
|
Show details
|
|
|
|