| 2 |
LATIC: A Non-native Pre-labelled Mandarin Chinese Validation Corpus for Automatic Speech Scoring and Evaluation Task ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Investigating the attitude towards ambiguity: Interindividual differences in automatic activations of evaluations of ambiguity ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Human evaluation of three machine translation systems : from quality to attitudes by professional translators
|
|
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Identifying language disorder in bilingual children using automatic speech recognition : a feasibility study
|
|
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Investigating the attitude towards ambiguity: Interindividual differences in automatic activations of evaluations of ambiguity
|
|
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Rapid development of competitive translation engines for access to multilingual COVID-19 information
|
|
|
|
In: Way, Andy orcid:0000-0001-5736-5930 , Haque, Rejwanul orcid:0000-0003-1680-0099 , Xie, Guodong, Gaspari, Federico orcid:0000-0003-3808-8418 , Popović, Maja orcid:0000-0001-8234-8745 and Poncelas, Alberto orcid:0000-0002-5089-1687 (2020) Rapid development of competitive translation engines for access to multilingual COVID-19 information. Informatics . ISSN 2227-9709 (2020)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Fine-grained text simplification in French: steps towards a better grammaticality
|
|
|
|
In: ISHIMR Proceedings of the 18th International Symposium on Health Information Management Research ; https://hal.archives-ouvertes.fr/hal-03095247 ; ISHIMR Proceedings of the 18th International Symposium on Health Information Management Research, Sep 2020, Kalmar, Sweden. ⟨10.15626/ishimr.2020.xxx⟩ (2020)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
French coreference for spoken and written language
|
|
|
|
In: Language Resources and Evaluation Conference (LREC 2020) ; https://hal.archives-ouvertes.fr/hal-02476902 ; Language Resources and Evaluation Conference (LREC 2020), 2020, Marseille, France. pp.80-89 ; https://www.aclweb.org/anthology/2020.lrec-1.10 (2020)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Speech recognition in the context of lectures : assessment, progress and enrichment ; Reconnaissance de la parole dans un contexte de cours magistraux : évaluation, avancées et enrichissement
|
|
|
|
In: https://tel.archives-ouvertes.fr/tel-02928451 ; Informatique et langage [cs.CL]. Le Mans Université, 2020. Français. ⟨NNT : 2020LEMA1008⟩ (2020)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
An English-Chinese Machine Translation and Evaluation Method for Geographical Names
|
|
|
|
In: ISPRS International Journal of Geo-Information ; Volume 9 ; Issue 3 (2020)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
A Framework for Word Embedding Based Automatic Text Summarization and Evaluation
|
|
|
|
In: Information ; Volume 11 ; Issue 2 (2020)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
RuBQ: A Russian Dataset for Question Answering over Wikidata
|
|
|
|
In: Lect. Notes Comput. Sci. ; Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (2020)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
A Survey on evaluation of summarization methods
|
|
|
|
In: ISSN: 1873-5371 ; EISSN: 1873-5371 ; Information processing & management ; https://hal.univ-brest.fr/hal-02130700 ; Information processing & management, [Oxford]: Elsevier Ltd., 2019, 56 (5), pp.1794-1814. ⟨10.1016/j.ipm.2019.04.001⟩ ; https://www.sciencedirect.com/science/article/abs/pii/S0306457318306241?via%3Dihub (2019)
|
|
Abstract:
International audience ; The increasing volume of textual information on any topic requires its compression to allow humans to digest it. This implies detecting the most important information and condensing it. These challenges have led to new developments in the area of Natural Language Processing (NLP) and Information Retrieval (IR) such as narrative summarization and evaluation methodologies for narrative extraction. Despite some progress over recent years with several solutions for information extraction and text summarization, the problems of generating consistent narrative summaries and evaluating them are still unresolved. With regard to evaluation, manual assessment is expensive, subjective and not applicable in real time or to large collections. Moreover, it does not provide re-usable benchmarks. Nevertheless, commonly used metrics for summary evaluation still imply substantial human effort since they require a comparison of candidate summaries with a set of reference summaries. The contributions of this paper are three-fold. First, we provide a comprehensive overview of existing metrics for summary evaluation. We discuss several limitations of existing frameworks for summary evaluation. Second, we introduce an automatic framework for the evaluation of metrics that does not require any human annotation. Finally, we evaluate the existing assessment metrics on a Wikipedia data set and a collection of scientific articles using this framework. Our findings show that the majority of existing metrics based on vocabulary overlap are not suitable for assessment based on comparison with a full text and we discuss this outcome.
|
|
Keyword:
[INFO]Computer Science [cs]; [SHS.LITT]Humanities and Social Sciences/Literature; [SHS]Humanities and Social Sciences; assessment metrics; automatic summarization; evaluation campaigns; extraction; extractive summarization; ROUGE; text compression
|
|
URL: https://doi.org/10.1016/j.ipm.2019.04.001
https://hal.univ-brest.fr/hal-02130700
https://hal.univ-brest.fr/hal-02130700/document
https://hal.univ-brest.fr/hal-02130700/file/S0306457318306241.pdf
|
|
BASE
|
|
Hide details
|
|
|
| 15 |
Investigating backtranslation for the improvement of English-Irish machine translation
|
|
|
|
In: Dowling, Meghan orcid:0000-0003-1637-4923 , Lynn, Teresa and Way, Andy orcid:0000-0001-5736-5930 (2019) Investigating backtranslation for the improvement of English-Irish machine translation. Teanga, 26 . pp. 1-25. ISSN 0332-205X (2019)
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Webinar: Social Transportation Analytic Toolbox (STAT) for Transit Networks
|
|
|
|
In: TREC Webinar Series (2019)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Evaluación basada en errores: estudio comparativo de Google Traductor y Deeplerror-based ; Evaluation: comparative study of Google Translate and Deepl
|
|
|
|
BASE
|
|
Show details
|
|
|
|
|
