| 1 |
Entity-Based Semantic Adequacy for Data-to-Text Generation
|
|
|
|
In: Findings of the Association for Computational Linguistics: EMNLP 2021 ; Proceeddings of the 2021 Conference on Empirical Methods in Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-03461309 ; Proceeddings of the 2021 Conference on Empirical Methods in Natural Language Processing, Nov 2021, Punta Cana, Dominican Republic. pp.1530--1540 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
An Error Analysis Framework for Shallow Surface Realisation
|
|
|
|
In: EISSN: 2307-387X ; Transactions of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-03159422 ; Transactions of the Association for Computational Linguistics, The MIT Press, 2021, 9 ; https://www.aclweb.org/anthology/venues/tacl/ (2021)
|
|
Abstract:
International audience ; The metrics standardly used to evaluate Natural Language Generation (NLG) models,such as BLEU or METEOR, fail to provide information on which linguistic factors impact performance. Focusing on Surface Realisation (SR), the task of converting an unordered dependency tree into a well-formed sentence, we propose a framework for error analysis which permits identifying which features of the input affect the models’ results. This framework consists of two main components: (i) correlation analyses between a wide range of syntactic metrics and standard performance metrics and (ii) a set of techniques to automatically identify syntactic constructs which often co-occur with low performance scores. We demonstrate the advantages of our framework by performing error analysis on the results of 174 system runs submitted to the Multilingual SR shared tasks; we show that dependency edge accuracy correlate with automatic metrics thereby providing a more interpretable basis for evaluation; and we suggest ways in which our framework could be used to improve models and data. The framework is available in the form of a toolkit which can be used both by campaign organisers to provide detailed, linguistically interpretable feedback on the state of the art in multilingual SR, and by individual researchers to improve models and datasets.
|
|
Keyword:
[INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]
|
|
URL: https://hal.archives-ouvertes.fr/hal-03159422
https://hal.archives-ouvertes.fr/hal-03159422/document
https://hal.archives-ouvertes.fr/hal-03159422/file/2021.tacl-1.26.pdf
|
|
BASE
|
|
Hide details
|
|
|
| 3 |
Discourse-Based Sentence Splitting
|
|
|
|
In: ACL Anthology ; EMNLP 2021 The 2021 Conference on Empirical Methods in Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-03461298 ; EMNLP 2021 The 2021 Conference on Empirical Methods in Natural Language Processing, Nov 2021, Punta Cana, Dominican Republic. pp.1530-1540 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Gathering Information and Engaging the User ComBot : A Task-Based, Serendipitous Dialog Model for Patient-Doctor Interactions
|
|
|
|
In: Proceedings of the Second Workshop on Natural Language Processing for Medical Conversations ; NLPMC 2021 - Second Workshop on Natural Language Processing for Medical Conversations ; https://hal.archives-ouvertes.fr/hal-03461330 ; NLPMC 2021 - Second Workshop on Natural Language Processing for Medical Conversations, Jun 2021, Mexico, Mexico. pp.21-29 ; https://aclanthology.org/2021.nlpmc-1.3 (2021)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Active Learning and Multi-label Classification for Ellipsis and Coreference Detection in Conversational Question-Answering
|
|
|
|
In: 12th International Workshop on Spoken Dialog System Technology (IWSDS 2021) ; https://hal.archives-ouvertes.fr/hal-03533906 ; 12th International Workshop on Spoken Dialog System Technology (IWSDS 2021), Nov 2021, Singapour/Virtual, Singapore (2021)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Entity-Based Semantic Adequacy for Data-to-Text Generation ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 7 |
An Error Analysis Framework for Shallow Surface Realisation ...
|
|
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Quality of syntactic implication of RL-based sentence summarization
|
|
|
|
In: AAAI Workshop on Engineering Dependable and Secure Machine Learning Systems 2020 ; https://hal.archives-ouvertes.fr/hal-02883327 ; AAAI Workshop on Engineering Dependable and Secure Machine Learning Systems 2020, Feb 2020, New York, United States (2020)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
The 2020 Bilingual, Bi-Directional WebNLG+ Shared Task Overview and Evaluation Results (WebNLG+ 2020)
|
|
|
|
In: Proceedings of the 3rd International Workshop on Natural Language Generation from the Semantic Web (WebNLG+) ; https://hal.archives-ouvertes.fr/hal-03148418 ; Proceedings of the 3rd International Workshop on Natural Language Generation from the Semantic Web (WebNLG+), Dec 2020, Dublin/Virtual, Ireland (2020)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Multilingual AMR-to-Text Generation
|
|
|
|
In: 2020 Conference on Empirical Methods in Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-02999676 ; 2020 Conference on Empirical Methods in Natural Language Processing, Nov 2020, Punta Cana, Dominican Republic (2020)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
Augmenting Transformers with KNN-Based Composite Memory for Dialog
|
|
|
|
In: EISSN: 2307-387X ; Transactions of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-02999678 ; Transactions of the Association for Computational Linguistics, The MIT Press, In press, ⟨10.1162/tacl_a_00356⟩ ; https://transacl.org/index.php/tacl (2020)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
Modeling Global and Local Node Contexts for Text Generation from Knowledge Graphs
|
|
|
|
In: EISSN: 2307-387X ; Transactions of the Association for Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-03020314 ; Transactions of the Association for Computational Linguistics, The MIT Press, 2020, 8, ⟨10.1162/tacl_a_00332⟩ (2020)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
Learning Health-Bots from Training Data that was Automatically Created using Paraphrase Detection and Expert Knowledge
|
|
|
|
In: Proceedings of the 28th Conference on Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-03020294 ; Proceedings of the 28th Conference on Computational Linguistics, Dec 2020, Barcelona, Spain (2020)
|
|
BASE
|
|
Show details
|
|
|
| 14 |
RL extraction of syntax-based chunks for sentence compression
|
|
|
|
In: ICANN 2019 ; https://hal.archives-ouvertes.fr/hal-02323821 ; ICANN 2019, Sep 2019, Munich, Germany. pp.337-347 (2019)
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Surface Realisation Using Full Delexicalisation
|
|
|
|
In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) ; 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-02277069 ; 2019 Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing, Nov 2019, Hong Kong, China. pp.3084-3094, ⟨10.18653/v1/D19-1305⟩ (2019)
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Generating Text from Anonymised Structures
|
|
|
|
In: Proceedings of the 12th International Conference on Natural Language Generation ; https://hal.archives-ouvertes.fr/hal-02460312 ; Proceedings of the 12th International Conference on Natural Language Generation, Oct 2019, Hong Kong, China. pp.112 - 117 (2019)
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Revisiting the Binary Linearization Technique for Surface Realization
|
|
|
|
In: Proceedings of The 12th International Conference on Natural Language Generation ; https://hal.archives-ouvertes.fr/hal-02460309 ; Proceedings of The 12th International Conference on Natural Language Generation, 2019, pp.268 - 278 (2019)
|
|
BASE
|
|
Show details
|
|
|
| 18 |
LORIA / Lorraine University at Multilingual Surface Realisation 2019
|
|
|
|
In: Proceedings of the 2nd Workshop on Multilingual Surface Realisation (MSR 2019) ; https://hal.archives-ouvertes.fr/hal-02459998 ; Proceedings of the 2nd Workshop on Multilingual Surface Realisation (MSR 2019), Nov 2019, Hong Kong, Hong Kong SAR China. pp.88-93, ⟨10.18653/v1/D19-6312⟩ (2019)
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Creating a Corpus for Russian Data-to-Text Generation Using Neural Machine Translation and Post-Editing
|
|
|
|
In: Proceedings of the 7th Workshop on Balto-Slavic Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-02460000 ; Proceedings of the 7th Workshop on Balto-Slavic Natural Language Processing, Aug 2019, Florence, Italy. pp.44-49, ⟨10.18653/v1/W19-3706⟩ (2019)
|
|
BASE
|
|
Show details
|
|
|
| 20 |
Generating Syntactic Paraphrases
|
|
|
|
In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing ; https://hal.archives-ouvertes.fr/hal-03046028 ; Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Oct 2018, Brussels, Belgium. pp.937-943, ⟨10.18653/v1/D18-1113⟩ (2018)
|
|
BASE
|
|
Show details
|
|
|
|
|
