1 |
GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records ...
|
|
Yang, Xi; PourNejatian, Nima; Shin, Hoo Chang; Smith, Kaleb E; Parisien, Christopher; Compas, Colin; Martin, Cheryl; Flores, Mona G; Zhang, Ying; Magoc, Tanja; Harle, Christopher A; Lipori, Gloria; Mitchell, Duane A; Hogan, William R; Shenkman, Elizabeth A; Bian, Jiang; Wu, Yonghui. - : arXiv, 2022
|
|
Abstract:
Objective: To develop a large pretrained clinical language model from scratch using transformer architecture; systematically examine how transformer models of different sizes could help 5 clinical natural language processing (NLP) tasks at different linguistic levels. Methods: We created a large corpus with >90 billion words from clinical narratives (>82 billion words), scientific literature (6 billion words), and general English text (2.5 billion words). We developed GatorTron models from scratch using the BERT architecture of different sizes including 345 million, 3.9 billion, and 8.9 billion parameters, compared GatorTron with three existing transformer models in the clinical and biomedical domain on 5 different clinical NLP tasks including clinical concept extraction, relation extraction, semantic textual similarity, natural language inference, and medical question answering, to examine how large transformer models could help clinical NLP at different linguistic levels. Results and Conclusion: ... : 24 pages, 2 figures, 3 tables ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences; Machine Learning cs.LG
|
|
URL: https://dx.doi.org/10.48550/arxiv.2203.03540 https://arxiv.org/abs/2203.03540
|
|
BASE
|
|
Hide details
|
|
2 |
Applications of Explainable Artificial Intelligence in Diagnosis and Surgery
|
|
|
|
In: Diagnostics; Volume 12; Issue 2; Pages: 237 (2022)
|
|
BASE
|
|
Show details
|
|
3 |
The Effect of on Educational Technology on EFL Learners’ Self-Efficacy
|
|
|
|
In: Front Psychol (2022)
|
|
BASE
|
|
Show details
|
|
4 |
The cuff leak test in critically ill patients: An international survey of intensivists
|
|
|
|
In: ISSN: 0001-5172 ; EISSN: 1399-6576 ; Acta Anaesthesiologica Scandinavica ; https://hal.archives-ouvertes.fr/hal-03401785 ; Acta Anaesthesiologica Scandinavica, Wiley, 2021, 65 (8), pp.1087-1094. ⟨10.1111/aas.13838⟩ (2021)
|
|
BASE
|
|
Show details
|
|
5 |
An End-to-End Progressive Multi-Task Learning Framework for Medical Named Entity Recognition and Normalization ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
A Language Model-based Generative Classifier for Sentence-level Discourse Parsing ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Target-oriented Fine-tuning for Zero-Resource Named Entity Recognition ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
The Neural Processing of Vocal Emotion After Hearing Reconstruction in Prelingual Deaf Children: A Functional Near-Infrared Spectroscopy Brain Imaging Study
|
|
|
|
In: Front Neurosci (2021)
|
|
BASE
|
|
Show details
|
|
9 |
The predictive power of saliva electrolytes exceeds that of saliva microbiomes in diagnosing early childhood caries
|
|
|
|
In: J Oral Microbiol (2021)
|
|
BASE
|
|
Show details
|
|
10 |
Developmental consequences of children born from mothers with telbivudine treatment during late pregnancy: A prospective study with 3-year follow-up
|
|
|
|
In: Virulence (2021)
|
|
BASE
|
|
Show details
|
|
11 |
Dynamic methylome of internal mRNA N(7)-methylguanosine and its regulatory role in translation
|
|
|
|
In: Cell Res (2019)
|
|
BASE
|
|
Show details
|
|
12 |
AN EXAMINED LIFE OF A LANGUAGE TEACHER OF CHINESE: AN AUTOETHNOGRAPHIC INVESTIGATION INTO AGENCY
|
|
|
|
In: Doctoral Dissertations (2019)
|
|
BASE
|
|
Show details
|
|
13 |
Additional file 1: of Spatial and temporal clustering analysis of tuberculosis in the mainland of China at the prefecture level, 2005â 2015 ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Additional file 1: of Spatial and temporal clustering analysis of tuberculosis in the mainland of China at the prefecture level, 2005â 2015 ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
A Contrast of L1 Pronominal Usage: Japanese and Mandarin in Oral Narratives
|
|
Zhang, Ying. - : Ohio State University. Libraries, 2018
|
|
BASE
|
|
Show details
|
|
16 |
Telerehabilitation Combined Speech-Language and Cognitive Training Effectively Promoted Recovery in Aphasia Patients
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Une nouvelle architecture intégrant les données lexicales générales, terminologiques et « situées » : Pivax-3
|
|
|
|
In: Terminology & Ontology: Theories and applications TOTh 2017 ; https://hal.archives-ouvertes.fr/hal-01712276 ; Terminology & Ontology: Theories and applications TOTh 2017, Jun 2017, Chambéry, France (2017)
|
|
BASE
|
|
Show details
|
|
19 |
明代職官中英辭典 Chinese-English Dictionary of Ming Government Official Titles
|
|
|
|
BASE
|
|
Show details
|
|
20 |
明代職官中英辭典 Chinese-English Dictionary of Ming Government Official Titles
|
|
|
|
In: Zhang, Ying; Xue, Susan; Xue, Zhaohui; & Ni, Li. (2017). 明代職官中英辭典 Chinese-English Dictionary of Ming Government Official Titles. UC Irvine: UC Irvine Libraries. Retrieved from: http://www.escholarship.org/uc/item/2bz3v185 (2017)
|
|
BASE
|
|
Show details
|
|
|
|