1 |
A New Generation of Perspective API: Efficient Multilingual Character-level Transformers ...
|
|
|
|
Abstract:
On the world wide web, toxic content detectors are a crucial line of defense against potentially hateful and offensive messages. As such, building highly effective classifiers that enable a safer internet is an important research area. Moreover, the web is a highly multilingual, cross-cultural community that develops its own lingo over time. As such, it is crucial to develop models that are effective across a diverse range of languages, usages, and styles. In this paper, we present the fundamentals behind the next version of the Perspective API from Google Jigsaw. At the heart of the approach is a single multilingual token-free Charformer model that is applicable across a range of languages, domains, and tasks. We demonstrate that by forgoing static vocabularies, we gain flexibility across a variety of settings. We additionally outline the techniques employed to make such a byte-level model efficient and feasible for productionization. Through extensive experiments on multilingual toxic comment ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; Computers and Society cs.CY; FOS Computer and information sciences; Machine Learning cs.LG
|
|
URL: https://arxiv.org/abs/2202.11176 https://dx.doi.org/10.48550/arxiv.2202.11176
|
|
BASE
|
|
Hide details
|
|
2 |
MuMiN: A Large-Scale Multilingual Multimodal Fact-Checked Misinformation Social Network Dataset ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Quantifying knowledge synchronisation in the 21st century ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
An NLP Solution to Foster the Use of Information in Electronic Health Records for Efficiency in Decision-Making in Hospital Care ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Networks and Identity Drive Geographic Properties of the Diffusion of Linguistic Innovation ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Towards Responsible Natural Language Annotation for the Varieties of Arabic ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Who will share Fake-News on Twitter? Psycholinguistic cues in online post histories discriminate Between actors in the misinformation ecosystem ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Supply of engineering techniques and software design patterns in psychoanalysis and psychometrics sciences ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
Quantifying language changes surrounding mental health on Twitter ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Learning Activities in Colours and Rainbows for Programming Skill Development ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Analyzing a Carceral Algorithm used by the Pennsylvania Department of Corrections ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Breaking down disciplinary walls: redefining the teaching of Translation for Intercultural Dialogue
|
|
|
|
BASE
|
|
Show details
|
|
17 |
When the Echo Chamber Shatters: Examining the Use of Community-Specific Language Post-Subreddit Ban ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
GENder-IT: An Annotated English-Italian Parallel Challenge Set for Cross-Linguistic Natural Gender Phenomena ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Large Pre-trained Language Models Contain Human-like Biases of What is Right and Wrong to Do ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Proceedings of ICML 2021 Workshop on Theoretic Foundation, Criticism, and Application Trend of Explainable AI ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|