• Refine your search:
  • 
    Keyword:
    
    • [INFO.INFO-CL]Computer Science [cs] / Computation and Language [cs.CL] (3)
    • [INFO.INFO-AI]Computer Science [cs] / Artificial Intelligence [cs.AI] (1)
    • [INFO.INFO-SI]Computer Science [cs] / Social and Information Networks [cs.SI] (1)
    • [INFO.INFO-TT]Computer Science [cs] / Document and Text Processing (1)
  • 
    Creator / Publisher:
    
    • ANR-15-CE38-0011,SoSweet,Une sociolinguistique de Twitter : liens sociaux et variations linguistiques(2015) (3)
    • ANR-16-CE33-0021,PARSITI,Analyser l'impossible, Traduire l'improbable(2016) (3)
    • Automatic Language Modelling and ANAlysis & Computational Humanities (ALMAnaCH) (3)
    • Inria de Paris (3)
    • Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria) (3)
    • Seddah, Djamé (3)
    • Jawahar, Ganesh (2)
    • Sagot, Benoît (2)
    • ANR-11-IDEX-0005,USPC,Université Sorbonne Paris Cité(2011) (1)
    • ANR-18-CE38-0003,BASNUM,Numérisation et analyse du Dictionnaire universel de Basnage de Beauval: lexicographie et réseaux scientifiques(2018) (1)
    •   more
  • 
    Year:
    
    • 2019 (3)
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access:
    • free (3)
    • subject to license (0)

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 3 of 3 1 CamemBERT: a Tasty French Language Model Martin, Louis; Muller, Benjamin; Ortiz Suárez, Pedro Javier... In: https://hal.inria.fr/hal-02445946 ; 2019 (2019) BASE Show details 2 What does BERT learn about the structure of language? Jawahar, Ganesh; Sagot, Benoît; Seddah, Djamé In: ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics ; https://hal.inria.fr/hal-02131630 ; ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Jul 2019, Florence, Italy (2019) Abstract: International audience ; BERT is a recent language representation model that has surprisingly performed well in diverse language understanding benchmarks. This result indicates the possibility that BERT networks capture structural information about language. In this work, we provide novel support for this claim by performing a series of experiments to unpack the elements of English language structure learned by BERT. We first show that BERT's phrasal representation captures phrase-level information in the lower layers. We also show that BERT's intermediate layers encode a rich hierarchy of linguistic information, with surface features at the bottom, syntactic features in the middle and semantic features at the top. BERT turns out to require deeper layers when long-distance dependency information is required, e.g.~to track subject-verb agreement. Finally, we show that BERT representations capture linguistic information in a compositional way that mimics classical, tree-like structures. Keyword: [INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL] URL: https://hal.inria.fr/hal-02131630 https://hal.inria.fr/hal-02131630/file/intbert_acl19paper-3.pdf https://hal.inria.fr/hal-02131630/document BASE Hide details 3 Contextualized Diachronic Word Representations Jawahar, Ganesh; Seddah, Djamé In: 1st International Workshop on Computational Approaches to Historical Language Change 2019 (colocated with ACL 2019) ; https://hal.archives-ouvertes.fr/hal-02194763 ; 1st International Workshop on Computational Approaches to Historical Language Change 2019 (colocated with ACL 2019), Aug 2019, Florence, Italy (2019) BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 3 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0