23 |
Crowdsourcing Complex Language Resources: Playing to Annotate Dependency Syntax
|
|
|
|
In: International Conference on Computational Linguistics (COLING) ; https://hal.inria.fr/hal-01378980 ; International Conference on Computational Linguistics (COLING), Dec 2016, Osaka, Japan ; http://coling2016.anlp.jp/ (2016)
|
|
BASE
|
|
Show details
|
|
24 |
Crowdsourcing and curation: perspectives from biology and natural language processing.
|
|
|
|
BASE
|
|
Show details
|
|
25 |
Ethical Issues in Corpus Linguistics And Annotation: Pay Per Hit Does Not Affect Effective Hourly Rate For Linguistic Resource Development On Amazon Mechanical Turk
|
|
|
|
In: ETHics In Corpus collection, Annotation and Application workshop ; https://hal.inria.fr/hal-01324362 ; ETHics In Corpus collection, Annotation and Application workshop, May 2016, Portoroz, Slovenia (2016)
|
|
BASE
|
|
Show details
|
|
26 |
Éthique et traitement automatique des langues et de la parole : entre truismes et tabous
|
|
|
|
In: ISSN: 1248-9433 ; EISSN: 1965-0906 ; Revue TAL ; https://hal.archives-ouvertes.fr/hal-01422254 ; Revue TAL, ATALA (Association pour le Traitement Automatique des Langues), 2016, TAL et éthique, 57 (2), pp.7-19 ; https://www.atala.org/-Revue-TAL- (2016)
|
|
BASE
|
|
Show details
|
|
27 |
Crowdsourcing and curation: perspectives from biology and natural language processing
|
|
|
|
BASE
|
|
Show details
|
|
28 |
Ethical Issues in Corpus Linguistics And Annotation: Pay Per Hit Does Not Affect Effective Hourly Rate For Linguistic Resource Development On Amazon Mechanical Turk
|
|
|
|
Abstract:
Ethical issues reported with paid crowdsourcing include unfairly low wages. It is assumed that such issues are under the control of the task requester. Can one control the amount that a worker earns by controlling the amount that one pays? 412 linguistic data development tasks were submitted to Amazon Mechanical Turk. The pay per HIT was manipulated through a range of values. We examined the relationship between the pay that is offered per HIT and the effective pay rate. There is no such relationship. Paying more per HIT does not cause workers to earn more: the higher the pay per HIT, the more time workers spend on them (R = 0.92). So, the effective hourly rate stays roughly the same. The finding has clear implications for language resource builders who want to behave ethically: other means must be found in order to compensate workers fairly. The findings of this paper should not be taken as an endorsement of unfairly low pay rates for crowdsourcing workers. Rather, the intention is to point out that additional measures, such as pre-calculating and communicating to the workers an average hourly, rather than per-task, rate must be found in order to ensure an ethical rate of pay.
|
|
Keyword:
Article
|
|
URL: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC5860816/
|
|
BASE
|
|
Hide details
|
|
29 |
Analyse lexicale outillée de la parole transcrite de patients schizophrènes
|
|
|
|
In: ISSN: 1248-9433 ; EISSN: 1965-0906 ; Revue TAL ; https://hal.inria.fr/hal-01188677 ; Revue TAL, ATALA (Association pour le Traitement Automatique des Langues), 2015, Natural Language Processing and Cognition, 55 (3), pp.91 - 115 (2015)
|
|
BASE
|
|
Show details
|
|
30 |
Analyse lexicale outill{é}e de la parole transcrite de patients schizophr{è}nes ...
|
|
|
|
BASE
|
|
Show details
|
|
31 |
Mapping the Lexique des Verbes du Français (Lexicon of French Verbs) to a NLP Lexicon using Examples
|
|
|
|
In: International Conference on Language Resources and Evaluation (LREC) ; https://hal.inria.fr/hal-00969184 ; International Conference on Language Resources and Evaluation (LREC), May 2014, Reykjavik, Iceland (2014)
|
|
BASE
|
|
Show details
|
|
32 |
Propa-L: a Semantic Filtering Service from a Lexical Network Created using Games With A Purpose
|
|
|
|
In: 9th International Conference on Language Resources and Evaluation ; LREC: Language Resources and Evaluation Conference ; https://hal.inria.fr/hal-00969161 ; LREC: Language Resources and Evaluation Conference, May 2014, Reykjavik, Iceland. pp.1676-1681 ; http://www.lrec-conf.org/proceedings/lrec2014/index.html (2014)
|
|
BASE
|
|
Show details
|
|
33 |
Deep Syntax Annotation of the Sequoia French Treebank
|
|
|
|
In: International Conference on Language Resources and Evaluation (LREC) ; https://hal.inria.fr/hal-00969191 ; International Conference on Language Resources and Evaluation (LREC), May 2014, Reykjavik, Iceland (2014)
|
|
BASE
|
|
Show details
|
|
34 |
Evaluating Corpora Documentation with regards to the Ethics and Big Data Charter
|
|
|
|
In: International Conference on Language Resources and Evaluation (LREC) ; https://hal.inria.fr/hal-00969180 ; International Conference on Language Resources and Evaluation (LREC), May 2014, Reykjavik, Iceland (2014)
|
|
BASE
|
|
Show details
|
|
35 |
"Where the data are coming from?" Ethics, crowdsourcing and traceability for Big Data in Human Language Technology
|
|
|
|
In: Crowdsourcing and human computation multidisciplinary workshop ; https://hal.archives-ouvertes.fr/hal-01078045 ; Crowdsourcing and human computation multidisciplinary workshop, CNRS, Sep 2014, Paris, France (2014)
|
|
BASE
|
|
Show details
|
|
36 |
Crowdsourcing for Language Resource Development: Criticisms About Amazon Mechanical Turk Overpowering Use
|
|
|
|
In: Human Language Technology Challenges for Computer Science and Linguistics ; https://hal.inria.fr/hal-01053047 ; Vetulani, Zygmunt and Mariani, Joseph. Human Language Technology Challenges for Computer Science and Linguistics, 8387, Springer International Publishing, pp.303-314, 2014, Lecture Notes in Computer Science, 978-3-319-08957-7. ⟨10.1007/978-3-319-08958-4_25⟩ (2014)
|
|
BASE
|
|
Show details
|
|
37 |
Étude quantitative des disfluences dans le discours de schizophrènes : automatiser pour limiter les biais
|
|
|
|
In: TALN - Traitement Automatique des Langues Naturelles ; https://hal.inria.fr/hal-01054391 ; TALN - Traitement Automatique des Langues Naturelles, Jul 2014, Marseille, France. pp.292-303 (2014)
|
|
BASE
|
|
Show details
|
|
38 |
Un schéma d'annotation en dépendances syntaxiques profondes pour le français
|
|
|
|
In: TALN - Traitement Automatique des Langues Naturelles ; https://hal.inria.fr/hal-01054407 ; TALN - Traitement Automatique des Langues Naturelles, Jul 2014, Marseille, France. pp.574-579 (2014)
|
|
BASE
|
|
Show details
|
|
39 |
TCOF-POS : un corpus libre de français parlé annoté en morphosyntaxe
|
|
|
|
In: Actes de la conférence conjointe JEP-TALN-RECITAL 2012, volume 2: TALN ; JEP-TALN 2012 - Journées d'Études sur la Parole et conférence annuelle du Traitement Automatique des Langues Naturelles ; https://hal.archives-ouvertes.fr/hal-00709187 ; JEP-TALN 2012 - Journées d'Études sur la Parole et conférence annuelle du Traitement Automatique des Langues Naturelles, Jun 2012, Grenoble, France. pp.99-112 (2012)
|
|
BASE
|
|
Show details
|
|
40 |
Modeling the Complexity of Manual Annotation Tasks: a Grid of Analysis
|
|
|
|
In: Proceedings of the International Conference on Computational Linguistics (COLING 2012) ; International Conference on Computational Linguistics ; https://hal.archives-ouvertes.fr/hal-00769631 ; International Conference on Computational Linguistics, Dec 2012, Mumbaï, India. pp.895--910 (2012)
|
|
BASE
|
|
Show details
|
|
|
|