| 1 |
Smart Auto-completion in Live Chat Utilizing the Power of T5 ; Smart automatisk komplettering i livechatt som utnyttjar styrkan hos T5
|
|
Wang, Zhanpeng. - : KTH, Skolan för elektroteknik och datavetenskap (EECS), 2021
|
|
BASE
|
|
Show details
|
|
|
| 2 |
NECOS: An annotated corpus to identify constructive news comments in Spanish ; NECOS: Un corpus anotado para identificar comentarios constructivos de noticias en español
|
|
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Techniques Comparison for Natural Language Processing ...
|
|
|
|
Abstract:
These improvements open many possibilities in solving Natural Language Processing downstream tasks. Such tasks include machine translation, speech recognition, information retrieval, sentiment analysis, summarization, question answering, multilingual dialogue systems development, and many more. Language models are one of the most important components in solving each of the mentioned tasks. This paper is devoted to research and analysis of the most adopted techniques and designs for building and training language models that show a state of the art results. Techniques and components applied in the creation of language models and its parts are observed in this paper, paying attention to neural networks, embedding mechanisms, bidirectionality, encoder and decoder architecture, attention, and self-attention, as well as parallelization through using transformer. As a result, the most promising techniques imply pre-training and fine-tuning of a language model, attention-based neural network as a part of model ...
|
|
Keyword:
Attention; Decoder; Deep Learning; Embedding; Encoder; Gated Recurrent Unit; GRU; Language Model; Long Short-Term Memory; LSTM; Natural Language Processing; Neural Network; NLP; Recurrent Neural Network; RNN; Transfer Learning; Transformer
|
|
URL: https://dx.doi.org/10.5281/zenodo.3895814
https://zenodo.org/record/3895814
|
|
BASE
|
|
Hide details
|
|
|
|
|
