DE eng

Search in the Catalogues and Directories

Hits 1 – 5 of 5

1
Reflective Decoding: Beyond Unidirectional Generation with Off-the-Shelf Language Models ...
BASE
Show details
2
DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts ...
BASE
Show details
3
NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics ...
Lu, Ximing; Welleck, Sean; West, Peter. - : arXiv, 2021
BASE
Show details
4
NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints ...
NAACL 2021 2021; Lu, Ximing. - : Underline Science Inc., 2021
BASE
Show details
5
NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints ...
Abstract: Conditional text generation often requires lexical constraints, i.e., which words should or shouldn't be included in the output text. While the dominant recipe for conditional text generation has been large-scale pretrained language models that are finetuned on the task-specific training data, such models do not learn to follow the underlying constraints reliably, even when supervised with large amounts of task-specific examples. We propose NeuroLogic Decoding, a simple yet effective algorithm that enables neural language models -- supervised or not -- to generate fluent text while satisfying complex lexical constraints. Our approach is powerful yet efficient. It handles any set of lexical constraints that is expressible under predicate logic, while its asymptotic runtime is equivalent to conventional beam search. Empirical results on four benchmarks show that NeuroLogic Decoding outperforms previous approaches, including algorithms that handle a subset of our constraints. Moreover, we find that unsupervised ... : NAACL 2021 ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://arxiv.org/abs/2010.12884
https://dx.doi.org/10.48550/arxiv.2010.12884
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
5
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern