1 |
Sample, Translate, Recombine: Leveraging Audio Alignments for Data Augmentation in End-to-end Speech Translation ...
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Learning Neural Sequence-to-Sequence Models from Weak Feedback with Bipolar Ramp Loss ...
|
|
|
|
Abstract:
In many machine learning scenarios, supervision by gold labels is not available and consequently neural models cannot be trained directly by maximum likelihood estimation (MLE). In a weak supervision scenario, metric-augmented objectives can be employed to assign feedback to model outputs, which can be used to extract a supervision signal for training. We present several objectives for two separate weakly supervised tasks, machine translation and semantic parsing. We show that objectives should actively discourage negative outputs in addition to promoting a surrogate gold structure. This notion of bipolarity is naturally present in ramp loss objectives, which we adapt to neural models. We show that bipolar ramp loss objectives outperform other non-bipolar ramp loss objectives and minimum risk training (MRT) on both weakly supervised tasks, as well as on a supervised machine translation task. Additionally, we introduce a novel token-level ramp loss objective, which is able to outperform even the best ... : Transactions of the Association for Computational Linguistics 2019 Vol. 7, 233-248. Presented at ACL, Florence, Italy ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG; Machine Learning stat.ML
|
|
URL: https://arxiv.org/abs/1907.03748 https://dx.doi.org/10.48550/arxiv.1907.03748
|
|
BASE
|
|
Hide details
|
|
3 |
Improving a Neural Semantic Parser by Counterfactual Learning from Human Bandit Feedback ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Exploiting auxiliary distributions in stochastic unification-based grammars ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Lexicalized Stochastic Modeling of Constraint-Based Grammars using Log-Linear Measures and EM Training ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Estimators for Stochastic ``Unification-Based'' Grammars ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Using a Probabilistic Class-Based Lexicon for Lexical Ambiguity Resolution ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Inside-Outside Estimation of a Lexicalized PCFG for German ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Inducing a Semantically Annotated Lexicon via EM-Based Clustering ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|