| 1 |
A Multi-Level Optimization Framework for End-to-End Text Augmentation
|
|
|
|
In: Transactions of the Association for Computational Linguistics, Vol 10, Pp 343-358 (2022) (2022)
|
|
Abstract:
AbstractText augmentation is an effective technique in alleviating overfitting in NLP tasks. In existing methods, text augmentation and downstream tasks are mostly performed separately. As a result, the augmented texts may not be optimal to train the downstream model. To address this problem, we propose a three-level optimization framework to perform text augmentation and the downstream task end-to- end. The augmentation model is trained in a way tailored to the downstream task. Our framework consists of three learning stages. A text summarization model is trained to perform data augmentation at the first stage. Each summarization example is associated with a weight to account for its domain difference with the text classification data. At the second stage, we use the model trained at the first stage to perform text augmentation and train a text classification model on the augmented texts. At the third stage, we evaluate the text classification model trained at the second stage and update weights of summarization examples by minimizing the validation loss. These three stages are performed end-to-end. We evaluate our method on several text classification datasets where the results demonstrate the effectiveness of our method. Code is available at https://github.com/Sai-Ashish/End-to-End-Text-Augmentation.
|
|
Keyword:
Computational linguistics. Natural language processing; P98-98.5
|
|
URL: https://doi.org/10.1162/tacl_a_00464
https://doaj.org/article/0d46f8b8943d44ed9bbe8ffd5dca6002
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
Syntactic smt using a discriminative text generation model
|
|
|
|
In: http://aclweb.org/anthology/D/D14/D14-1021.pdf (2014)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Syntactic SMT Using a Discriminative Text Generation Model
|
|
|
|
In: http://emnlp2014.org/papers/pdf/EMNLP2014021.pdf
|
|
BASE
|
|
Show details
|
|
|
| 4 |
The ICT ’s Patent MT System Description for NTCIR-9
|
|
|
|
In: http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings9/NTCIR/19-NTCIR9-PATENTMT-XiongH.pdf
|
|
BASE
|
|
Show details
|
|
|
|
|
