1 |
Online Evaluation of Coreference Resolution
|
|
|
|
In: 4th International Conference on Language Resources and Evaluation - LREC'04 ; https://hal.inria.fr/halshs-00005023 ; 4th International Conference on Language Resources and Evaluation - LREC'04, 2004, Lisbonne, Portugal, 4 p (2004)
|
|
Abstract:
Colloque avec actes et comité de lecture. internationale. ; International audience ; This paper presents the design of an online evaluation service for coreference resolution in texts. We argue that coreference, as an equivalence relation between referring expressions (RE) in texts, should be properly distinguished from anaphora and has therefore to be evaluated separately. The annotation model for coreference is based on links between REs. The program presented in this article compares two such annotations, which may be the output of coreference resolution tools or of human judgement. In order to evaluate the agreement between the two annotations, the evaluator first converts the input annotation format into a pivot format, then abstracts equivalence classes from the links and provides five scores representing in different ways the similarity between the two partitions: MUC, B3, Kappa, Core-discourse-entity, and Mutual-information. Although we consider that the identification of REs (i.e. the elements of the partition) should not be part of coreference resolution properly speaking, we propose several solutions for the frequent case when the input files do not agree on the elements of the text to consider as REs.
|
|
Keyword:
[INFO.INFO-OH]Computer Science [cs]/Other [cs.OH]
|
|
URL: https://hal.inria.fr/halshs-00005023v2/document https://hal.inria.fr/halshs-00005023 https://hal.inria.fr/halshs-00005023v2/file/A04-R-554.pdf
|
|
BASE
|
|
Hide details
|
|
2 |
Standards going concrete: from LMF to Morphalou
|
|
|
|
In: Workshop Enhancing and Using Electronic Dictionaries ; https://hal.inria.fr/inria-00100195 ; Workshop Enhancing and Using Electronic Dictionaries, 2004, Geneva, Switzerland, 7 p (2004)
|
|
BASE
|
|
Show details
|
|
3 |
Lexical descriptions for Vietnamese language processing
|
|
|
|
In: The 1st International Joint Conference on Natural Language Processing - IJCNLP'04 / Workshop on Asian Language Resources ; https://hal.inria.fr/inria-00107760 ; The 1st International Joint Conference on Natural Language Processing - IJCNLP'04 / Workshop on Asian Language Resources, 2004, Sanya, Hainan Island, China, 8 p (2004)
|
|
BASE
|
|
Show details
|
|
4 |
Perspectives de normalisation pour les corpus et lexiques multilingues
|
|
|
|
In: Lexicométrie et corpus multilingues - JADT 2004 ; https://hal.inria.fr/inria-00100192 ; Lexicométrie et corpus multilingues - JADT 2004, 2004, Louvain-la-Neuve, Belgique (2004)
|
|
BASE
|
|
Show details
|
|
5 |
Developing Tools and Building Linguistic Resources for Vietnamese Morpho-Syntactic Processing
|
|
|
|
In: 4th International Conference on Language Resources and Evaluation - LREC'04 ; https://hal.inria.fr/inria-00107761 ; 4th International Conference on Language Resources and Evaluation - LREC'04, 2004, Lisbonne, Portugal. 4 p (2004)
|
|
BASE
|
|
Show details
|
|
6 |
La FReeBank : vers une base libre de corpus annotés
|
|
|
|
In: Traitement Automatique des Langues Naturelles - TALN'04 ; https://hal.inria.fr/inria-00100194 ; Traitement Automatique des Langues Naturelles - TALN'04, Apr 2004, Fès, Maroc. 10 p (2004)
|
|
BASE
|
|
Show details
|
|
7 |
Ethnonymie et ingénierie sémantique
|
|
|
|
In: Sources et ressources pour les sciences sociales ; https://hal.inria.fr/inria-00100168 ; Sources et ressources pour les sciences sociales, EHESS-CNRS-CdeF-EPHE-INT, Dec 2004, Paris, France (2004)
|
|
BASE
|
|
Show details
|
|
8 |
Terminology standards at work: exploring several scenarios to implement ISO 16642
|
|
|
|
In: Terminology in Advanced Management Applications. Multilingual Content Integration ; https://hal.inria.fr/inria-00110779 ; Terminology in Advanced Management Applications. Multilingual Content Integration, TermNet, 2004, Cologne, Allemagne (2004)
|
|
BASE
|
|
Show details
|
|
9 |
Construction of Grammar Based Term Extraction Model for Japanese
|
|
|
|
In: 3rd International Workshop on Computational Terminology - CompuTerm 2004 ; https://hal.inria.fr/inria-00107805 ; 3rd International Workshop on Computational Terminology - CompuTerm 2004, 2004, Geneva, Suisse. pp.91-94 (2004)
|
|
BASE
|
|
Show details
|
|
10 |
A Registry of Standard Data Categories for Linguistic Annotation
|
|
|
|
In: 4th International Conference on Language Resources and Evaluation - LREC'04 ; https://hal.inria.fr/inria-00099858 ; 4th International Conference on Language Resources and Evaluation - LREC'04, 2004, Lisbonne, Portugal, pp.135-138 (2004)
|
|
BASE
|
|
Show details
|
|
11 |
Standardization in Multimodal Content Representation: Some Methodological Issues
|
|
|
|
In: 4th International Conference on Language Resources and Evaluation - LREC'04 ; https://hal.inria.fr/inria-00100199 ; 4th International Conference on Language Resources and Evaluation - LREC'04, 2004, Lisbonne, Portugal. 28 p (2004)
|
|
BASE
|
|
Show details
|
|
12 |
An on-line data category registry for linguistic resource management
|
|
|
|
In: LREC Workshop ; https://hal.inria.fr/inria-00100198 ; LREC Workshop, 2004, Lisbonne, Portugal, 8 p (2004)
|
|
BASE
|
|
Show details
|
|
13 |
Apports possibles de la normalisation à la linguistique de corpus
|
|
|
|
In: Ecole thématique linguistique de corpus : constitution, archivage, évaluation ; https://hal.inria.fr/inria-00100190 ; Ecole thématique linguistique de corpus : constitution, archivage, évaluation, 2004, Caen, France, 79 p (2004)
|
|
BASE
|
|
Show details
|
|
14 |
Une étude de cas pour l'étiquetage morpho-syntaxique de textes vietnamiens
|
|
|
|
In: Traitement Automatique des Langues Naturelles - TALN'2003 ; https://hal.inria.fr/inria-00107642 ; Traitement Automatique des Langues Naturelles - TALN'2003, ATALA (Association pour le Traitement Automatique des LAngues), Jun 2003, Batz-sur-mer, France (2003)
|
|
BASE
|
|
Show details
|
|
15 |
Extraction d'information à base d'ontologies dans une application de veille
|
|
|
|
In: 5ème Rencontre Terminologie et Intelligence Artificielle - TIA'2003 ; https://hal.inria.fr/inria-00107715 ; 5ème Rencontre Terminologie et Intelligence Artificielle - TIA'2003, 2003, Strasbourg, France, pp.205-208 (2003)
|
|
BASE
|
|
Show details
|
|
16 |
Towards Reusable NLP Components
|
|
|
|
In: Proc. of LREC 2002 ; Proceedings of the Third International Conference on Language Resources and Evaluation ; https://hal.inria.fr/inria-00100763 ; Proceedings of the Third International Conference on Language Resources and Evaluation, European Language Resources Association (ELRA), May 2002, Las Palmas, Iles Canaries, Spain. pp.1116-1123 (2002)
|
|
BASE
|
|
Show details
|
|
17 |
LREP: A Language Repository Exchange Protocol
|
|
|
|
In: Third International Conference on Language Resources and Evaluation - LREC'2002 ; https://hal.inria.fr/inria-00100770 ; Third International Conference on Language Resources and Evaluation - LREC'2002, May 2002, Las Palmas, Spain (2002)
|
|
BASE
|
|
Show details
|
|
18 |
Ancrage référentiel en situation de dialogue
|
|
|
|
In: ISSN: 1248-9433 ; EISSN: 1965-0906 ; Revue TAL ; https://hal.inria.fr/inria-00100981 ; Revue TAL, ATALA (Association pour le Traitement Automatique des Langues), 2002, 43 (2), pp.99-129 (2002)
|
|
BASE
|
|
Show details
|
|
19 |
Standards for Language Resources
|
|
|
|
In: Proc. of LREC 2002 ; LREC 2002 - Third International Conference on Language Resources and Evaluation ; https://hal.inria.fr/inria-00100771 ; LREC 2002 - Third International Conference on Language Resources and Evaluation, May 2002, Las Palmas, Spain. pp.9 ; http://www.lrec-conf.org/proceedings/lrec2002/ (2002)
|
|
BASE
|
|
Show details
|
|
20 |
A Common XML-based Framework for Syntactic Annotations
|
|
|
|
In: Proc. of 1st NLP and XML Workshop ; 1st NLP and XML Workshop ; https://hal.inria.fr/inria-00100592 ; 1st NLP and XML Workshop, Nov 2001, Tokyo, Japan, Japan (2001)
|
|
BASE
|
|
Show details
|
|
|
|