| 1 |
An Error Analysis Framework for Shallow Surface Realisation
|
|
|
|
In: EISSN: 2307-387X ; Transactions of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-03159422 ; Transactions of the Association for Computational Linguistics, The MIT Press, 2021, 9 ; https://www.aclweb.org/anthology/venues/tacl/ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
|
|
|
|
In: Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021) ; https://hal.archives-ouvertes.fr/hal-03466171 ; Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021), Aug 2021, Online, France. pp.96-120, ⟨10.18653/v1/2021.gem-1.10⟩ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
A Systematic Review of Reproducibility Research in Natural Language Processing
|
|
|
|
In: Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume ; https://hal.archives-ouvertes.fr/hal-03466170 ; Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, Apr 2021, Online, France. pp.381-393, ⟨10.18653/v1/2021.eacl-main.29⟩ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Natural Language Generation : From Data Creation to Evaluation via Modelling ; Génération en langue naturelle : de la création des données à l'évaluation, en passant par la modélisation
|
|
|
|
In: https://hal.univ-lorraine.fr/tel-03254708 ; Computation and Language [cs.CL]. Université de Lorraine, 2021. English. ⟨NNT : 2021LORR0080⟩ (2021)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics ...
|
|
Gehrmann, Sebastian; Adewumi, Tosin; Aggarwal, Karmanya; Ammanamanchi, Pawan Sasanka; Anuoluwapo, Aremu; Bosselut, Antoine; Chandu, Khyathi Raghavi; Clinciu, Miruna; Das, Dipanjan; Dhole, Kaustubh D.; Du, Wanyu; Durmus, Esin; Dušek, Ondřej; Emezue, Chris; Gangal, Varun; Garbacea, Cristina; Hashimoto, Tatsunori; Hou, Yufang; Jernite, Yacine; Jhamtani, Harsh; Ji, Yangfeng; Jolly, Shailza; Kale, Mihir; Kumar, Dhruv; Ladhak, Faisal; Madaan, Aman; Maddela, Mounica; Mahajan, Khyati; Mahamood, Saad; Majumder, Bodhisattwa Prasad; Martins, Pedro Henrique; McMillan-Major, Angelina; Mille, Simon; van Miltenburg, Emiel; Nadeem, Moin; Narayan, Shashi; Nikolaev, Vitaly; Niyongabo, Rubungo Andre; Osei, Salomey; Parikh, Ankur; Perez-Beltrachini, Laura; Rao, Niranjan Ramesh; Raunak, Vikas; Rodriguez, Juan Diego; Santhanam, Sashank; Sedoc, João; Sellam, Thibault; Shaikh, Samira; Shimorina, Anastasia; Cabezudo, Marco Antonio Sobrevilla. - : arXiv, 2021
|
|
Abstract:
We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving ecosystem of automated metrics, datasets, and human evaluation standards. Due to this moving target, new models often still evaluate on divergent anglo-centric corpora with well-established, but flawed, metrics. This disconnect makes it challenging to identify the limitations of current models and opportunities for progress. Addressing this limitation, GEM provides an environment in which models can easily be applied to a wide set of tasks and in which evaluation strategies can be tested. Regular updates to the benchmark will help NLG research become more multilingual and evolve the challenge alongside models. This paper serves as the description of the data for which we are organizing a shared task at our ACL 2021 Workshop and to which we invite the entire NLG community to participate. ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG
|
|
URL: https://dx.doi.org/10.48550/arxiv.2102.01672
https://arxiv.org/abs/2102.01672
|
|
BASE
|
|
Hide details
|
|
|
| 6 |
An Error Analysis Framework for Shallow Surface Realisation ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 7 |
The 2020 Bilingual, Bi-Directional WebNLG+ Shared Task Overview and Evaluation Results (WebNLG+ 2020)
|
|
|
|
In: Proceedings of the 3rd International Workshop on Natural Language Generation from the Semantic Web (WebNLG+) ; https://hal.archives-ouvertes.fr/hal-03148418 ; Proceedings of the 3rd International Workshop on Natural Language Generation from the Semantic Web (WebNLG+), Dec 2020, Dublin/Virtual, Ireland (2020)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Surface Realisation Using Full Delexicalisation
|
|
|
|
In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) ; 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-02277069 ; 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Nov 2019, Hong Kong, China. pp.3084-3094, ⟨10.18653/v1/D19-1305⟩ (2019)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Can static vocal tract positions represent articulatory targets in continuous speech? Matching static MRI captures against real-time MRI for the French language
|
|
|
|
In: ICPhS 2019 - International Congress of Phonetic Sciences ; https://hal.inria.fr/hal-02181314 ; ICPhS 2019 - International Congress of Phonetic Sciences, Aug 2019, Melbourne, Australia (2019)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
LORIA / Lorraine University at Multilingual Surface Realisation 2019
|
|
|
|
In: Proceedings of the 2nd Workshop on Multilingual Surface Realisation (MSR 2019) ; https://hal.archives-ouvertes.fr/hal-02459998 ; Proceedings of the 2nd Workshop on Multilingual Surface Realisation (MSR 2019), Nov 2019, Hong Kong, Hong Kong SAR China. pp.88-93, ⟨10.18653/v1/D19-6312⟩ (2019)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Creating a Corpus for Russian Data-to-Text Generation Using Neural Machine Translation and Post-Editing
|
|
|
|
In: Proceedings of the 7th Workshop on Balto-Slavic Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-02460000 ; Proceedings of the 7th Workshop on Balto-Slavic Natural Language Processing, Aug 2019, Florence, Italy. pp.44-49, ⟨10.18653/v1/W19-3706⟩ (2019)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Handling Rare Items in Data-to-Text Generation
|
|
|
|
In: Proceedings of the 11th International Conference on Natural Language Generation ; https://hal.archives-ouvertes.fr/hal-02460010 ; Proceedings of the 11th International Conference on Natural Language Generation, Nov 2018, Tilburg University, Netherlands. pp.360-370, ⟨10.18653/v1/W18-6543⟩ (2018)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Split and Rephrase
|
|
|
|
In: EMNLP 2017: Conference on Empirical Methods in Natural Language Processing ; https://hal.inria.fr/hal-01623746 ; EMNLP 2017: Conference on Empirical Methods in Natural Language Processing, Sep 2017, Copenhagen, Denmark. pp.617 - 627 (2017)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
The WebNLG Challenge: Generating Text from RDF Data
|
|
|
|
In: Proceedings of the 10th International Conference on Natural Language Generation ; https://hal.archives-ouvertes.fr/hal-02461197 ; Proceedings of the 10th International Conference on Natural Language Generation, Sep 2017, Santiago de Compostela, Spain. pp.124-133, ⟨10.18653/v1/W17-3518⟩ (2017)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Creating Training Corpora for NLG Micro-Planning
|
|
|
|
In: 55th annual meeting of the Association for Computational Linguistics (ACL) ; https://hal.inria.fr/hal-01623744 ; 55th annual meeting of the Association for Computational Linguistics (ACL), Jul 2017, Vancouver, Canada (2017)
|
|
BASE
|
|
Show details
|
|
|
|
|
