2 |
A Call for More Rigor in Unsupervised Cross-lingual Learning ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Learning and Evaluating General Linguistic Intelligence ...
|
|
Yogatama, Dani; d'Autume, Cyprien de Masson; Connor, Jerome; Kocisky, Tomas; Chrzanowski, Mike; Kong, Lingpeng; Lazaridou, Angeliki; Ling, Wang; Yu, Lei; Dyer, Chris; Blunsom, Phil. - : arXiv, 2019
|
|
Abstract:
We define general linguistic intelligence as the ability to reuse previously acquired knowledge about a language's lexicon, syntax, semantics, and pragmatic conventions to adapt to new tasks quickly. Using this definition, we analyze state-of-the-art natural language understanding models and conduct an extensive empirical investigation to evaluate them against these criteria through a series of experiments that assess the task-independence of the knowledge being acquired by the learning process. In addition to task performance, we propose a new evaluation metric based on an online encoding of the test data that quantifies how quickly an existing agent (model) learns a new task. Our results show that while the field has made impressive progress in terms of model architectures that generalize to many tasks, these models still require a lot of in-domain training examples (e.g., for fine tuning, training task-specific modules), and are prone to catastrophic forgetting. Moreover, we find that far from solving ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG; Machine Learning stat.ML
|
|
URL: https://dx.doi.org/10.48550/arxiv.1901.11373 https://arxiv.org/abs/1901.11373
|
|
BASE
|
|
Hide details
|
|
4 |
On the Cross-lingual Transferability of Monolingual Representations ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Learning to Compose Words into Sentences with Reinforcement Learning ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Learning Word Representations with Hierarchical Sparse Coding ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Learning Word Representations with Hierarchical Sparse Coding ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Learning Word Representations with Hierarchical Sparse Coding ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Predicting a Scientific Community’s Response to an Article ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
Predicting a Scientific Community’s Response to an Article ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Part-of-Speech Tagging for Twitter: Annotation, Features, and Experiments
|
|
|
|
In: DTIC (2010)
|
|
BASE
|
|
Show details
|
|
|
|