1 |
Sex differences in the intrinsic reading neural networks of Chinese children
|
|
|
|
In: Dev Cogn Neurosci (2022)
|
|
BASE
|
|
Show details
|
|
2 |
Re-synchronization using the Hand Preceding Model for Multi-modal Fusion in Automatic Continuous Cued Speech Recognition
|
|
|
|
In: ISSN: 1520-9210 ; IEEE Transactions on Multimedia ; https://hal.archives-ouvertes.fr/hal-02433830 ; IEEE Transactions on Multimedia, Institute of Electrical and Electronics Engineers, 2021, 23, pp.292-305. ⟨10.1109/TMM.2020.2976493⟩ (2021)
|
|
BASE
|
|
Show details
|
|
3 |
An Attention Self-supervised Contrastive Learning based Three-stage Model for Hand Shape Feature Representation in Cued Speech ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Cross-Modal Knowledge Distillation Method for Automatic Cued Speech Recognition ...
|
|
|
|
Abstract:
Cued Speech (CS) is a visual communication system for the deaf or hearing impaired people. It combines lip movements with hand cues to obtain a complete phonetic repertoire. Current deep learning based methods on automatic CS recognition suffer from a common problem, which is the data scarcity. Until now, there are only two public single speaker datasets for French (238 sentences) and British English (97 sentences). In this work, we propose a cross-modal knowledge distillation method with teacher-student structure, which transfers audio speech information to CS to overcome the limited data problem. Firstly, we pretrain a teacher model for CS recognition with a large amount of open source audio speech data, and simultaneously pretrain the feature extractors for lips and hands using CS data. Then, we distill the knowledge from teacher model to the student model with frame-level and sequence-level distillation strategies. Importantly, for frame-level, we exploit multi-task learning to weigh losses ...
|
|
Keyword:
Audio and Speech Processing eess.AS; FOS Computer and information sciences; FOS Electrical engineering, electronic engineering, information engineering; Image and Video Processing eess.IV; Multimedia cs.MM; Sound cs.SD
|
|
URL: https://dx.doi.org/10.48550/arxiv.2106.13686 https://arxiv.org/abs/2106.13686
|
|
BASE
|
|
Hide details
|
|
5 |
WeChat as a Platform for Problem-Based Learning Among Hematological Postgraduates: Feasibility and Acceptability Study
|
|
|
|
In: J Med Internet Res (2021)
|
|
BASE
|
|
Show details
|
|
6 |
Dietary Habit Is Associated with Depression and Intelligence: An Observational and Genome-Wide Environmental Interaction Analysis in the UK Biobank Cohort
|
|
|
|
In: Nutrients (2021)
|
|
BASE
|
|
Show details
|
|
7 |
Disrupted Subcortical-Cortical Connections in a Phonological but Not Semantic Task in Chinese Children With Dyslexia
|
|
|
|
In: Front Hum Neurosci (2021)
|
|
BASE
|
|
Show details
|
|
8 |
Balancing information-structure and semantic constraints on construction choice: building a computational model of passive and passive-like constructions in Mandarin Chinese
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Intrinsic Cerebro-Cerebellar Functional Connectivity Reveals the Function of Cerebellum VI in Reading-Related Skills
|
|
|
|
BASE
|
|
Show details
|
|
10 |
Functional parcellation of the right cerebellar lobule VI in children with normal or impaired reading
|
|
|
|
In: Neuropsychologia (2020)
|
|
BASE
|
|
Show details
|
|
12 |
Piano training enhances the neural processing of pitch and improves speech perception in Mandarin-speaking children
|
|
|
|
In: PNAS (2019)
|
|
BASE
|
|
Show details
|
|
13 |
Restaurant Inspection and Training Factors Associated with Foodborne Disease and Food Handler Knowledge
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Associations between Environmental Tobacco Smoke Exposure in Early Life and Astigmatism among Chinese Preschool Children
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Neural mechanisms for selectively tuning in to the target speaker in a naturalistic noisy situation.
|
|
|
|
In: Nature communications, vol 9, iss 1 (2018)
|
|
BASE
|
|
Show details
|
|
18 |
Additional file 1: of Risk factors affecting the mortality of HIV-infected patients with pulmonary tuberculosis in the cART era: a retrospective cohort study in China ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Additional file 1: of Risk factors affecting the mortality of HIV-infected patients with pulmonary tuberculosis in the cART era: a retrospective cohort study in China ...
|
|
|
|
BASE
|
|
Show details
|
|
20 |
Improving Sequence-to-Sequence Acoustic Modeling by Adding Text-Supervision ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|