2 |
The (un)suitability of automatic evaluation metrics for text simplification
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Assessing idiomaticity representations in vector models with a noun compound dataset labeled at type and token levels
|
|
|
|
Abstract:
Accurate assessment of the ability of embedding models to capture idiomaticity may require evaluation at token rather than type level, to account for degrees of idiomaticity and possible ambiguity between literal and idiomatic usages. However, most existing resources with annotation of idiomaticity include ratings only at type level. This paper presents the Noun Compound Type and Token Idiomaticity (NCTTI) dataset, with human annotations for 280 noun compounds in English and 180 in Portuguese at both type and token level. We compiled 8,725 and 5,091 token level annotations for English and Portuguese, respectively, which are strongly correlated with the corresponding scores obtained at type level. The NCTTI dataset is used to explore how vector space models reflect the variability of idiomaticity across sentences. Several experiments using state-of-the-art contextualised models suggest that their representations are not capturing the noun compounds idiomaticity as human annotators. This new multilingual resource also contains suggestions for paraphrases of the noun compounds both at type and token levels, with uses for lexical substitution or disambiguation in context.
|
|
URL: http://eprints.whiterose.ac.uk/173800/
|
|
BASE
|
|
Hide details
|
|
5 |
Multistage BiCross encoder for multilingual access to COVID-19 health information
|
|
|
|
BASE
|
|
Show details
|
|
6 |
The false COVID-19 narratives that keep being debunked : a spatiotemporal analysis
|
|
|
|
BASE
|
|
Show details
|
|
7 |
AStitchInLanguageModels : dataset and methods for the exploration of idiomaticity in pre-trained language models
|
|
|
|
BASE
|
|
Show details
|
|
8 |
ASSET : a dataset for tuning and evaluation of sentence simplification models with multiple rewriting transformations
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Toxic language detection in social media for Brazilian Portuguese : new dataset and multilingual analysis
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Measuring what counts : the case of rumour stance classification
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Exploring gap filling as a cheaper alternative to reading comprehension questionnaires when evaluating machine translation for gisting
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Automatic classification of written descriptions by healthy adults: An overview of the application of natural language processing and machine learning techniques to clinical discourse analysis
|
|
|
|
BASE
|
|
Show details
|
|
|
|