DE eng

Search in the Catalogues and Directories

Hits 1 – 5 of 5

1
Reflective Decoding: Beyond Unidirectional Generation with Off-the-Shelf Language Models ...
BASE
Show details
2
DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Experts ...
BASE
Show details
3
NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics ...
Abstract: The dominant paradigm for neural text generation is left-to-right decoding from autoregressive language models. Constrained or controllable generation under complex lexical constraints, however, requires foresight to plan ahead feasible future paths. Drawing inspiration from the A* search algorithm, we propose NeuroLogic A*esque, a decoding algorithm that incorporates heuristic estimates of future cost. We develop efficient lookahead heuristics that are efficient for large-scale language models, making our method a drop-in replacement for common techniques such as beam search and top-k sampling. To enable constrained generation, we build on NeuroLogic decoding (Lu et al., 2021), combining its flexibility in incorporating logical constraints with A*esque estimates of future constraint satisfaction. Our approach outperforms competitive baselines on five generation tasks, and achieves new state-of-the-art performance on table-to-text generation, constrained machine translation, and keyword-constrained ...
Keyword: Computation and Language cs.CL; FOS Computer and information sciences
URL: https://dx.doi.org/10.48550/arxiv.2112.08726
https://arxiv.org/abs/2112.08726
BASE
Hide details
4
NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints ...
NAACL 2021 2021; Lu, Ximing. - : Underline Science Inc., 2021
BASE
Show details
5
NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
5
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern