1 |
A Multi-modal Machine Learning Approach and Toolkit to Automate Recognition of Early Stages of Dementia among British Sign Language Users
|
|
|
|
BASE
|
|
Show details
|
|
2 |
Adaptation of the British Sign Language Receptive Skills Test into Polish Sign Language
|
|
|
|
BASE
|
|
Show details
|
|
3 |
Real Time Hand Movement Trajectory Tracking for Enhancing Dementia Screening in Ageing Deaf Signers of British Sign Language
|
|
|
|
Abstract:
Real time hand movement trajectory tracking based on machine learning approaches may assist the early identification of dementia in ageing Deaf individuals who are users of British Sign Language (BSL), since there are few clinicians with appropriate communication skills, and a shortage of sign language interpreters. Unlike other computer vision systems used in dementia stage assessment such as RGB-D video with the aid of depth camera, activities of daily living (ADL) monitored by information and communication technologies (ICT) facilities, or X-Ray, computed tomography (CT), and magnetic resonance imaging (MRI) images fed to machine learning algorithms, the system developed here focuses on analysing the sign language space envelope(sign trajectories/depth/speed) and facial expression of deaf individuals, using normal 2D videos. In this work, we are interested in providing a more accurate segmentation of objects of interest in relation to the background, so that accurate real-time hand trajectories (path of the trajectory and speed) can be achieved. The paper presents and evaluates two types of hand movement trajectory models. In the first model, the hand sign trajectory is tracked by implementing skin colour segmentation. In the second model, the hand sign trajectory is tracked using Part Afinity Fields based on the OpenPose Skeleton Model [1, 2]. Comparisons of results between the two different models demonstrate that the second model provides enhanced improvements in terms of tracking accuracy and robustness of tracking. The pattern differences in facial and trajectory motion data achieved from the presented models will be beneficial not only for screening of deaf individuals for dementia, but also for assessment of other acquired neurological impairments associated with motor changes, for example, stroke and Parkinsons disease.
|
|
Keyword:
Artificial Neural Networks; British Sign Language; Dementia; Hand Tracking; Machine Learning; OpenPose; Segmentation; Time-series Data Analytics
|
|
URL: https://westminsterresearch.westminster.ac.uk/download/3fed60dfb13a5fdfd833a3dccbc2424a64328d2a9b3dca435e248cf6ba0cbe15/4240084/CD_MAKE.pdf https://westminsterresearch.westminster.ac.uk/item/qvv22/real-time-hand-movement-trajectory-tracking-for-enhancing-dementia-screening-in-ageing-deaf-signers-of-british-sign-language https://doi.org/10.1007/978-3-030-29726-8_24
|
|
BASE
|
|
Hide details
|
|
4 |
Deaf and hearing children's picture naming Impact of age of acquisition and language modality on representational gesture
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Unimodal bilingualism in the Deaf community: Language contact between two sign languages in Australia and the United Kingdom
|
|
Adam, REJ. - : UCL (University College London), 2017
|
|
In: Doctoral thesis, UCL (University College London). (2017)
|
|
BASE
|
|
Show details
|
|
6 |
Sign, language, and gesture in the brain: Some comments
|
|
|
|
In: Behavioral and Brain Sciences , 40 , Article e49. (2017) (In press). (2017)
|
|
BASE
|
|
Show details
|
|
7 |
Detecting Memory Impairment in Deaf People: A New Test of Verbal Learning and Memory in British Sign Language
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Monitoring Different Phonological Parameters of Sign Language Engages the Same Cortical Language Network but Distinctive Perceptual Ones
|
|
|
|
In: Journal of Cognitive Neuroscience , 28 (1) pp. 20-40. (2016) (2016)
|
|
BASE
|
|
Show details
|
|
9 |
Synesthesia for manual alphabet letters and numeral signs in second-language users of signed languages
|
|
|
|
In: Neurocase , 22 (4) pp. 379-386. (2016) (2016)
|
|
BASE
|
|
Show details
|
|
10 |
Sociolinguistics of Deaf Communities.
|
|
|
|
In: Journal of Sociolinguistics , 20 (2) pp. 245-249. (2016) (2016)
|
|
BASE
|
|
Show details
|
|
11 |
Detecting Memory Impairment in Deaf People: A New Test of Verbal Learning and Memory in British Sign Language
|
|
|
|
In: Archives of Clinical Neuropsychology , 31 (8) pp. 855-867. (2016) (2016)
|
|
BASE
|
|
Show details
|
|
12 |
Differential activity in Heschl's gyrus between deaf and hearing individuals is due to auditory deprivation rather than language modality
|
|
|
|
In: Neuroimage , 124 (A) pp. 96-106. (2016) (2016)
|
|
BASE
|
|
Show details
|
|
13 |
Detecting cognitive impairment and dementia in Deaf people: The British Sign Language Cognitive Screening Test
|
|
|
|
BASE
|
|
Show details
|
|
14 |
Constructing an online test framework, using the example of a sign language receptive skills test
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Research Methods in Studying Reading and Literacy Development in Deaf Children Who Sign
|
|
|
|
BASE
|
|
Show details
|
|
16 |
Documentary and corpus approaches to sign language research
|
|
|
|
In: In: Orfanidou, E and Woll, B and Morgan, G, (eds.) The Blackwell Guide to Research Methods in Sign Language Studies. (pp. 156-172). Blackwell: Oxford. (2015) (2015)
|
|
BASE
|
|
Show details
|
|
17 |
Stimulus rate increases lateralisation in linguistic and non-linguistic tasks measured by functional transcranial Doppler sonography.
|
|
|
|
In: Neuropsychologia , 72 59 - 69. (2015) (2015)
|
|
BASE
|
|
Show details
|
|
18 |
Detecting Cognitive Impairment and Dementia in Deaf People: The British Sign Language Cognitive Screening Test.
|
|
|
|
In: Arch Clin Neuropsychol , 30 (7) pp. 694-711. (2015) (2015)
|
|
BASE
|
|
Show details
|
|
19 |
Identification of the regions involved in phonological assembly using a novel paradigm.
|
|
|
|
In: Brain and Language, vol. 150, pp. 45-53 (2015)
|
|
BASE
|
|
Show details
|
|
20 |
Sentence Repetition in Deaf Children with Specific Language Impairment in British Sign Language
|
|
|
|
BASE
|
|
Show details
|
|
|
|