| 1 |
A New Generation of Perspective API: Efficient Multilingual Character-level Transformers ...
|
|
|
|
Abstract:
On the world wide web, toxic content detectors are a crucial line of defense against potentially hateful and offensive messages. As such, building highly effective classifiers that enable a safer internet is an important research area. Moreover, the web is a highly multilingual, cross-cultural community that develops its own lingo over time. As such, it is crucial to develop models that are effective across a diverse range of languages, usages, and styles. In this paper, we present the fundamentals behind the next version of the Perspective API from Google Jigsaw. At the heart of the approach is a single multilingual token-free Charformer model that is applicable across a range of languages, domains, and tasks. We demonstrate that by forgoing static vocabularies, we gain flexibility across a variety of settings. We additionally outline the techniques employed to make such a byte-level model efficient and feasible for productionization. Through extensive experiments on multilingual toxic comment ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; Computers and Society cs.CY; FOS Computer and information sciences; Machine Learning cs.LG
|
|
URL: https://arxiv.org/abs/2202.11176
https://dx.doi.org/10.48550/arxiv.2202.11176
|
|
BASE
|
|
Hide details
|
|
|
| 2 |
ReasonBERT: Pre-trained to Reason with Distant Supervision ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|
|
