DE eng

Search in the Catalogues and Directories

Hits 1 – 2 of 2

1
The impact of topic bias on quality flaw prediction in Wikipedia ...
Ferschke, Oliver; Gurevych, Iryna; Rittberger, Marc. - : Association for Computational Linguistics (ACL), 2013
BASE
Show details
2
The impact of topic bias on quality flaw prediction in Wikipedia
In: Association of Computational Linguistics [Hrsg.]: 51st Annual Meeting of the Association for Computational Linguistics. Stroudsburg, Pa. : Association for Computational Linguistics (ACL) 2013, S. 721-730 (2013)
Abstract: With the increasing amount of user generated reference texts in the web, automatic quality assessment has become a key challenge. However, only a small amount of annotated data is available for training quality assessment systems. Wikipedia contains a large amount of texts annotated with cleanup templates which identify quality flaws. We show that the distribution of these labels is topically biased, since they cannot be applied freely to any arbitrary article. We argue that it is necessary to consider the topical restrictions of each label in order to avoid a sampling bias that results in a skewed classifier and overly optimistic evaluation results. We factor out the topic bias by extracting reliable training instances from the revision history which have a topic distribution similar to the labeled articles. This approach better reflects the situation a classifier would face in a real-life application. (DIPF/Orig.)
Keyword: Algorithm; Algorithms; Algorithmus; Bibliotheks- und Informationswissenschaft; Computerunterstütztes Verfahren; ddc:020; Evaluation; Library and information sciences; Nachschlagewerk; On line; Online; Qualität; Qualitätssicherung; Quality; Quality assurance; Reference book; Reliabilität; Reliability; Social Software; Soziale Software; Standard; World wide web 2.0
URL: http://nbn-resolving.de/urn:nbn:de:0111-dipfdocs-184570
https://www.pedocs.de/volltexte/2020/18457/pdf/The_impact_of_topic_bias_on_quality_flaw_prediction_in_Wikipedia_A.pdf
https://www.pedocs.de/volltexte/2020/18457/
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
2
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern