DE eng

Search in the Catalogues and Directories

Hits 1 – 2 of 2

1
Overview of the CLEF 2005 Multilingual Question Answering Track
In: http://www.clef-campaign.org/2005/working_notes/workingnotes2005/vallin05.pdf (2005)
BASE
Show details
2
Overview of the CLEF 2005 Multilingual Question Answering Track
In: http://www.science.uva.nl/~mdr/Publications/Files/clef-2005-qa-overview-wn.pdf (2005)
Abstract: The general aim of the third CLEF Multilingual Question Answering Track was to set up a common and replicable evaluation framework to test both monolingual and cross-language Question Answering (QA) systems that process queries and documents in several European languages. Nine target languages and ten source languages were exploited to enact 8 monolingual and 73 cross-language tasks. Twenty-four groups participated in the exercise.Overall results showed a general increase in performance in comparison to last year. The best performing monolingual system irrespective of target language answered 64.5 % of the questions correctly (in the monolingual Portuguese task), while the average of the best performances for each target language was 42.6%. The cross-language step instead entailed a considerable drop in performance. In addition to accuracy, the organisers also measured the relation between the correctness of an answer and a system’s stated confidence in it, showing that the best systems did not always provide the most reliable confidence score.
Keyword: Categories and Subject Descriptors H.3 [Information Storage and Retrieval; Experimentation Keywords Question answering; H.3.1 Content Analysis and Indexing; H.3.3 Information Search and Retrieval; H.3.4 Systems and Software; I.2 [Artificial Intelligence; I.2.7 Natural Language Processing General Terms Measurement; Performance
URL: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.77.2950
http://www.science.uva.nl/~mdr/Publications/Files/clef-2005-qa-overview-wn.pdf
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
2
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern