DE eng

Search in the Catalogues and Directories

Hits 1 – 5 of 5

1
Modular Mechanistic Networks: On Bridging Mechanistic and Phenomenological Models with Deep Neural Networks in Natural Language Processing ...
Dobnik, Simon; Kelleher, John D.. - : arXiv, 2018
BASE
Show details
2
What is not where: the challenge of integrating spatial representations into deep learning architectures ...
Kelleher, John D.; Dobnik, Simon. - : arXiv, 2018
BASE
Show details
3
Is it worth it? Budget-related evaluation metrics for model selection ...
Abstract: Creating a linguistic resource is often done by using a machine learning model that filters the content that goes through to a human annotator, before going into the final resource. However, budgets are often limited, and the amount of available data exceeds the amount of affordable annotation. In order to optimize the benefit from the invested human work, we argue that deciding on which model one should employ depends not only on generalized evaluation metrics such as F-score, but also on the gain metric. Because the model with the highest F-score may not necessarily have the best sequencing of predicted classes, this may lead to wasting funds on annotating false positives, yielding zero improvement of the linguistic resource. We exemplify our point with a case study, using real data from a task of building a verb-noun idiom dictionary. We show that, given the choice of three systems with varying F-scores, the system with the highest F-score does not yield the highest profits. In other words, in our case ... : 7 pages, 1 figure, 5 tables, In proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018) ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://arxiv.org/abs/1807.06998
https://dx.doi.org/10.48550/arxiv.1807.06998
BASE
Hide details
4
Is it worth it? Budget-related evaluation metrics for model selection
In: Conference papers (2018)
BASE
Show details
5
Exploring the Functional and Geometric Bias of Spatial Relations Using Neural Language Models
In: Conference papers (2018)
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
5
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern