Page: 1 2 3 4 5 6 7 8 9... 71
| 81 |
Visual generics: How adults understand generic language with different visualizations ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 82 |
Improving Multilingual Models for the Swedish Language : Exploring CrossLingual Transferability and Stereotypical Biases
|
|
|
|
BASE
|
|
Show details
|
|
|
| 83 |
Effects of EFL Learning on L1 Chinese Lexis
|
|
|
|
In: Sustainability; Volume 13; Issue 23; Pages: 13496 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 84 |
Automated Paraphrase Quality Assessment Using Language Models and Transfer Learning
|
|
|
|
In: Computers; Volume 10; Issue 12; Pages: 166 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 85 |
Transfer Capital or Transfer Deficit: A Dual Perspective of English Learning of ESL College Transfer Students
|
|
|
|
In: Sustainability; Volume 14; Issue 1; Pages: 214 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 86 |
DATLMedQA: A Data Augmentation and Transfer Learning Based Solution for Medical Question Answering
|
|
|
|
In: Applied Sciences; Volume 11; Issue 23; Pages: 11251 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 87 |
Modeling Heritage Language Phonetics and Phonology: Toward an Integrated Multilingual Sound System
|
|
|
|
In: Languages; Volume 6; Issue 4; Pages: 209 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 88 |
NASca and NASes: Two Monolingual Pre-Trained Models for Abstractive Summarization in Catalan and Spanish
|
|
|
|
In: Applied Sciences ; Volume 11 ; Issue 21 (2021)
|
|
Abstract:
Most of the models proposed in the literature for abstractive summarization are generally suitable for the English language but not for other languages. Multilingual models were introduced to address that language constraint, but despite their applicability being broader than that of the monolingual models, their performance is typically lower, especially for minority languages like Catalan. In this paper, we present a monolingual model for abstractive summarization of textual content in the Catalan language. The model is a Transformer encoder-decoder which is pretrained and fine-tuned specifically for the Catalan language using a corpus of newspaper articles. In the pretraining phase, we introduced several self-supervised tasks to specialize the model on the summarization task and to increase the abstractivity of the generated summaries. To study the performance of our proposal in languages with higher resources than Catalan, we replicate the model and the experimentation for the Spanish language. The usual evaluation metrics, not only the most used ROUGE measure but also other more semantic ones such as BertScore, do not allow to correctly evaluate the abstractivity of the generated summaries. In this work, we also present a new metric, called content reordering, to evaluate one of the most common characteristics of abstractive summaries, the rearrangement of the original content. We carried out an exhaustive experimentation to compare the performance of the monolingual models proposed in this work with two of the most widely used multilingual models in text summarization, mBART and mT5. The experimentation results support the quality of our monolingual models, especially considering that the multilingual models were pretrained with many more resources than those used in our models. Likewise, it is shown that the pretraining tasks helped to increase the degree of abstractivity of the generated summaries. To our knowledge, this is the first work that explores a monolingual approach for abstractive summarization both in Catalan and Spanish.
|
|
Keyword:
abstractive summarization; monolingual models; multilingual models; transfer learning; transformer models
|
|
URL: https://doi.org/10.3390/app11219872
|
|
BASE
|
|
Hide details
|
|
|
| 89 |
Heritage Tagalog Phonology and a Variationist Framework of Language Contact
|
|
|
|
In: Languages; Volume 6; Issue 4; Pages: 201 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 90 |
Reusing Monolingual Pre-Trained Models by Cross-Connecting Seq2seq Models for Machine Translation
|
|
|
|
In: Applied Sciences ; Volume 11 ; Issue 18 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 91 |
Generating Synthetic Disguised Faces with Cycle-Consistency Loss and an Automated Filtering Algorithm
|
|
|
|
In: Mathematics; Volume 10; Issue 1; Pages: 4 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 92 |
Methods for Detoxification of Texts for the Russian Language
|
|
|
|
In: Multimodal Technologies and Interaction ; Volume 5 ; Issue 9 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 93 |
Machine Translation in Low-Resource Languages by an Adversarial Neural Network
|
|
|
|
In: Applied Sciences; Volume 11; Issue 22; Pages: 10860 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 94 |
3D Expression-Invariant Face Verification Based on Transfer Learning and Siamese Network for Small Sample Size
|
|
|
|
In: Electronics ; Volume 10 ; Issue 17 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 95 |
Spanish-Catalan linguistic transfers: A study of lexical availability in Lleida ; Transferències lingüístiques castellà-català: un estudi de disponibilitat lèxica a Lleida
|
|
|
|
In: Treballs de Sociolingüística Catalana; Núm. 31 (2021): L’estandardologia comparada: teoria i pràctica; 149-164 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 96 |
Держать, читать oder говорить доклад?! – Kollokationen und andere lexikalische Einheiten in der Sprachausbildung russischer Herkunftssprecher
|
|
|
|
BASE
|
|
Show details
|
|
|
| 97 |
Identifying Datooga loans in Iraqw - and the other way round ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 98 |
Identifying Datooga loans in Iraqw - and the other way round ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 99 |
Держать, читать oder говорить доклад?! – Kollokationen und andere lexikalische Einheiten in der Sprachausbildung russischer Herkunftssprecher ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 100 |
Surveying Motion Lexicalisation Patterns in L1-Portuguese/FL-English Bilinguals ...
|
|
|
|
BASE
|
|
Show details
|
|
|
Page: 1 2 3 4 5 6 7 8 9... 71 |
|
