DE eng

Search in the Catalogues and Directories

Hits 1 – 2 of 2

1
A Mutual Information Maximization Approach for the Spurious Solution Problem in Weakly Supervised Question Answering ...
Abstract: Read paper: https://www.aclanthology.org/2021.acl-long.318 Abstract: Weakly supervised question answering usually has only the final answers as supervision signals while the correct solutions to derive the answers are not provided. This setting gives rise to the spurious solution problem: there may exist many spurious solutions that coincidentally derive the correct answer, but training on such solutions can hurt model performance (e.g., producing wrong solutions or answers). For example, for discrete reasoning tasks as on DROP, there may exist many equations to derive a numeric answer, and typically only one of them is correct. Previous learning methods mostly filter out spurious solutions with heuristics or using model confidence, but do not explicitly exploit the semantic correlations between a question and its solution. In this paper, to alleviate the spurious solution problem, we propose to explicitly exploit such semantic correlations by maximizing the mutual information between question-answer pairs ...
Keyword: Computational Linguistics; Condensed Matter Physics; Deep Learning; Electromagnetism; FOS Physical sciences; Information and Knowledge Engineering; Neural Network; Semantics
URL: https://dx.doi.org/10.48448/d3t6-tg47
https://underline.io/lecture/25678-a-mutual-information-maximization-approach-for-the-spurious-solution-problem-in-weakly-supervised-question-answering
BASE
Hide details
2
AutoTinyBERT: Automatic Hyper-parameter Optimization for Efficient Pre-trained Language Models ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
2
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern