1 |
Constrained Language Models Yield Few-Shot Semantic Parsers ...
|
|
The 2021 Conference on Empirical Methods in Natural Language Processing 2021; Chen, Charles; Eisner, Jason; Klein, Dan; Lin, Christopher; Pauls, Adam; Platanios, Emmanouil Antonios; Roy, Subhro; Shin, Richard; Thomson, Sam; Van Durme, Benjamin. - : Underline Science Inc., 2021
|
|
Abstract:
Anthology paper link: https://aclanthology.org/2021.emnlp-main.608/ Abstract: We explore the use of large pretrained language models as few-shot semantic parsers. The goal in semantic parsing is to generate a structured meaning representation given a natural language input. However, language models are trained to generate natural language. To bridge the gap, we use language models to paraphrase inputs into a controlled sublanguage resembling English that can be automatically mapped to a target meaning representation. Our results demonstrate that with only a small amount of data and very little code to convert into English-like representations, our blueprint for rapidly bootstrapping semantic parsers leads to surprisingly effective performance on multiple community tasks, greatly exceeding baseline methods also trained on the same limited data. ...
|
|
Keyword:
Computational Linguistics; Language Models; Machine Learning; Machine Learning and Data Mining; Natural Language Processing
|
|
URL: https://dx.doi.org/10.48448/4a5g-s070 https://underline.io/lecture/37889-constrained-language-models-yield-few-shot-semantic-parsers
|
|
BASE
|
|
Hide details
|
|
3 |
Searching for More Efficient Dynamic Programs
|
|
|
|
In: Findings of the Association for Computational Linguistics: EMNLP 2021 (2021)
|
|
BASE
|
|
Show details
|
|
7 |
A Corpus for Large-Scale Phonetic Typology
|
|
|
|
In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (2020)
|
|
BASE
|
|
Show details
|
|
9 |
Are All Languages Equally Hard to Language-Model?
|
|
|
|
In: Proceedings of the Society for Computation in Linguistics (2019)
|
|
BASE
|
|
Show details
|
|
10 |
A Generative Model for Punctuation in Dependency Trees
|
|
|
|
In: Transactions of the Association for Computational Linguistics, Vol 7, Pp 357-373 (2019) (2019)
|
|
BASE
|
|
Show details
|
|
11 |
On the Complexity and Typology of Inflectional Morphological Systems
|
|
|
|
In: Transactions of the Association for Computational Linguistics, Vol 7, Pp 327-342 (2019) (2019)
|
|
BASE
|
|
Show details
|
|
12 |
Spell Once, Summon Anywhere: A Two-Level Open-Vocabulary Language Model ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
On the Complexity and Typology of Inflectional Morphological Systems ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Unsupervised Disambiguation of Syncretism in Inflected Lexicons ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
Predicting Fine-Grained Syntactic Typology from Surface Features
|
|
|
|
In: Proceedings of the Society for Computation in Linguistics (2018)
|
|
BASE
|
|
Show details
|
|
18 |
Quantifying the Trade-off Between Two Types of Morphological Complexity
|
|
|
|
In: Proceedings of the Society for Computation in Linguistics (2018)
|
|
BASE
|
|
Show details
|
|
19 |
Probabilistic Typology: Deep Generative Models of Vowel Inventories ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Probabilistic Typology: Deep Generative Models of Vowel Inventories ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|