2 |
A Methodology to Transform Speech into Symbolic Gestures ...
|
|
|
|
BASE
|
|
Show details
|
|
3 |
A Methodology to Transform Speech into Symbolic Gestures ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Different Language Modalities Yet Similar Cognitive Processes in Arithmetic Fact Retrieval
|
|
|
|
In: Brain Sciences; Volume 12; Issue 2; Pages: 145 (2022)
|
|
BASE
|
|
Show details
|
|
5 |
American Sign Language Words Recognition of Skeletal Videos Using Processed Video Driven Multi-Stacked Deep LSTM
|
|
|
|
In: Sensors; Volume 22; Issue 4; Pages: 1406 (2022)
|
|
Abstract:
Complex hand gesture interactions among dynamic sign words may lead to misclassification, which affects the recognition accuracy of the ubiquitous sign language recognition system. This paper proposes to augment the feature vector of dynamic sign words with knowledge of hand dynamics as a proxy and classify dynamic sign words using motion patterns based on the extracted feature vector. In this method, some double-hand dynamic sign words have ambiguous or similar features across a hand motion trajectory, which leads to classification errors. Thus, the similar/ambiguous hand motion trajectory is determined based on the approximation of a probability density function over a time frame. Then, the extracted features are enhanced by transformation using maximal information correlation. These enhanced features of 3D skeletal videos captured by a leap motion controller are fed as a state transition pattern to a classifier for sign word classification. To evaluate the performance of the proposed method, an experiment is performed with 10 participants on 40 double hands dynamic ASL words, which reveals 97.98% accuracy. The method is further developed on challenging ASL, SHREC, and LMDHG data sets and outperforms conventional methods by 1.47%, 1.56%, and 0.37%, respectively.
|
|
Keyword:
American sign language words; bidirectional long short-term memory; computer vision; deep learning; dynamic hand gestures; leap motion controller sensor; sign language recognition; ubiquitous system; video processing
|
|
URL: https://doi.org/10.3390/s22041406
|
|
BASE
|
|
Hide details
|
|
7 |
Interview with Natasha Ofili
|
|
|
|
In: Journal of Religion & Film (2022)
|
|
BASE
|
|
Show details
|
|
8 |
Demonstratives in Nsélišcn ‘Montana Salish’
|
|
|
|
In: Graduate Student Theses, Dissertations, & Professional Papers (2022)
|
|
BASE
|
|
Show details
|
|
9 |
The linguistic representation of number: Cross-linguistic and cross-modal perspectives
|
|
|
|
BASE
|
|
Show details
|
|
10 |
WALS Online Resources for American Sign Language
|
|
: Max Planck Institute for Evolutionary Anthropology, 2021
|
|
BASE
|
|
Show details
|
|
11 |
Data for: Deaf children of hearing parents develop age-level vocabularies if exposed to ASL by six-months ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
When Hands Are Used to Communicate, They Are Less Susceptible to Illusion Than When They Are Used to Estimate ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
The Power of Sign: Gesture, Speech, Memory, and Agency in English-ASL Bilinguals. ...
|
|
|
|
BASE
|
|
Show details
|
|
14 |
DEV - Development of Temporal Visual Selective Attention in Deaf Children ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Translation and Picture Naming: Assessing effects of iconicity in American Sign Language ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Data for: Deaf children of hearing parents develop age-level vocabularies if exposed to ASL by six-months ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
When hands are used to communicate they are less susceptible to illusion than when they are used to estimate ...
|
|
|
|
BASE
|
|
Show details
|
|
18 |
The Difference Between American Sign Language and Body Language in Greetings ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
The Difference Between American Sign Language and Body Language in Greetings ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|