• Refine your search:
  • 
    Keyword:
    
    • Computation and Language cs.CL (2)
    • FOS Computer and information sciences (2)
    • Computational Linguistics (1)
    • Computational linguistics. Natural language processing (1)
    • P98-98.5 (1)
    • acceptability (1)
    • evaluation (1)
    • language model (1)
    • n-gram (1)
    • transformer (1)
  • 
    Creator / Publisher:
    
    • Bowman, Samuel R. (5)
    • Liu, Haokun (5)
    • Mohananey, Anhad (5)
    • Parrish, Alicia (5)
    • Peng, Wei (5)
    • Wang, Sheng-Fu (5)
    • Warstadt, Alex (5)
    • Alsop, Anna (1)
    • Blix, Hagen (1)
    • Bordia, Shikha (1)
    •   more
  • 
    Year
  • 
    Medium
  • 
    Type
  • 
    BLLDB-Access

Search in the Catalogues and Directories

All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year AND OR AND NOT All fields Title Creator / Publisher Keyword Year Sort by creator [A → Z]' creator [Z → A]' publishing year ↑ (asc)' publishing year ↓ (desc)' title [A → Z]' title [Z → A]' Simple Search Hits 1 – 5 of 5 1 BLiMP: A Benchmark of Linguistic Minimal Pairs for English ... Warstadt, Alex; Parrish, Alicia; Liu, Haokun. - : University of Mass Amherst, 2020 BASE Show details 2 BLiMP: A Benchmark of Linguistic Minimal Pairs for English Warstadt, Alex; Parrish, Alicia; Liu, Haokun; Mohananey, Anhad; Peng, Wei; Wang, Sheng-Fu; Bowman, Samuel R. In: Proceedings of the Society for Computation in Linguistics (2020) Abstract: We introduce BLiMP (The Benchmark of Linguistic Minimal Pairs), a human-solvable challenge set for evaluating language models (LMs) that covers a broad range of major grammatical phenomena in English. BLiMP consists of over 30 datasets, each containing 1000 minimal pairs isolating specific contrasts in syntax, morphology, or semantics. Like GLUE (Wang et al., 2018), BLiMP makes it easy to directly compare models. Evaluating n-gram, LSTM, and Transformer LMs (GPT-2 and TransformerXL), we find that transformers are strongest overall, achieving (near) human performance on agreement and binding. However, phenomena like wh-islands and NPI licensing remain challenging even for state-of-the-art LMs. Keyword: acceptability; Computational Linguistics; evaluation; language model; n-gram; transformer URL: https://scholarworks.umass.edu/scil/vol3/iss1/43 https://scholarworks.umass.edu/cgi/viewcontent.cgi?article=1143&context=scil BASE Hide details 3 BLiMP: The Benchmark of Linguistic Minimal Pairs for English Warstadt, Alex; Parrish, Alicia; Liu, Haokun... In: Transactions of the Association for Computational Linguistics, Vol 8, Pp 377-392 (2020) (2020) BASE Show details 4 Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIs ... Warstadt, Alex; Cao, Yu; Grosu, Ioana. - : arXiv, 2019 BASE Show details 5 BLiMP: The Benchmark of Linguistic Minimal Pairs for English ... Warstadt, Alex; Parrish, Alicia; Liu, Haokun. - : arXiv, 2019 BASE Show details

Mobile view All Catalogues UB Frankfurt Linguistik 0 IDS Mannheim 0 OLC Linguistik 0 UB Frankfurt Retrokatalog 0 DNB Subject Category Language 0 Institut für Empirische Sprachwissenschaft 0 Leibniz-Centre General Linguistics (ZAS) 0 Bibliographies BLLDB 0 BDSL 0 IDS Bibliografie zur deutschen Grammatik 0 IDS Bibliografie zur Gesprächsforschung 0 IDS Konnektoren im Deutschen 0 IDS Präpositionen im Deutschen 0 IDS OBELEX meta 0 MPI-SHH Linguistics Collection 0 MPI for Psycholinguistics 0 Linked Open Data catalogues Annohub 0 Online resources Link directory 0 Journal directory 0 Database directory 0 Dictionary directory 0 Open access documents BASE 5 Linguistik-Repository 0 IDS Publikationsserver 0 Online dissertations 0 Language Description Heritage 0