| 6 |
Searching for Search Errors in Neural Morphological Inflection ...
|
|
|
|
Abstract:
Neural sequence-to-sequence models are currently the predominant choice for language generation tasks. Yet, on word-level tasks, exact inference of these models reveals the empty string is often the global optimum. Prior works have speculated this phenomenon is a result of the inadequacy of neural models for language generation. However, in the case of morphological inflection, we find that the empty string is almost never the most probable solution under the model. Further, greedy search often finds the global optimum. These observations suggest that the poor calibration of many neural models may stem from characteristics of a specific subset of tasks rather than general ill-suitedness of such models for language generation. ... : Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume ...
|
|
URL: http://hdl.handle.net/20.500.11850/518999
https://dx.doi.org/10.3929/ethz-b-000518999
|
|
BASE
|
|
Hide details
|
|
|
| 7 |
Applying the Transformer to Character-level Transduction ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Examining the Inductive Bias of Neural Language Models with Artificial Languages ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Higher-order Derivatives of Weighted Finite-state Machines ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 19 |
A surprisal--duration trade-off across and within the world's languages ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|
|
