DE eng

Search in the Catalogues and Directories

Hits 1 – 11 of 11

1
BBC-Oxford British Sign Language Dataset
In: https://hal.archives-ouvertes.fr/hal-03516444 ; 2022 (2022)
BASE
Show details
2
Aligning Subtitles in Sign Language Videos
In: International Conference on Computer Vision (ICCV) ; https://hal.archives-ouvertes.fr/hal-03515983 ; International Conference on Computer Vision (ICCV), Oct 2021, Montreal, Canada (2021)
Abstract: International audience ; The goal of this work is to temporally align asynchronous subtitles in sign language videos. In particular, we focus on sign-language interpreted TV broadcast data comprising (i) a video of continuous signing, and (ii) subtitles corresponding to the audio content. Previous work exploiting such weakly-aligned data only considered finding keyword-sign correspondences, whereas we aim to localise a complete subtitle text in continuous signing. We propose a Transformer architecture tailored for this task, which we train on manually annotated alignments covering over 15K subtitles that span 17.7 hours of video. We use BERT subtitle embeddings and CNN video representations learned for sign recognition to encode the two signals, which interact through a series of attention layers. Our model outputs frame-level predictions, i.e., for each video frame, whether it belongs to the queried subtitle or not. Through extensive evaluations, we show substantial improvements over existing alignment baselines that do not make use of subtitle text embeddings for learning. Our automatic alignment model opens up possibilities for advancing machine translation of sign languages via providing continuously synchronized video-text data.
Keyword: [INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]; [INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]; [INFO]Computer Science [cs]
URL: https://hal.archives-ouvertes.fr/hal-03515983
BASE
Hide details
3
Read and Attend: Temporal Localisation in Sign Language Videos
In: 2021 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021) ; https://hal.archives-ouvertes.fr/hal-03513396 ; 2021 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021), Jun 2021, Nashville, TN, United States. ⟨10.1109/CVPR46437.2021.01658⟩ (2021)
BASE
Show details
4
Read and Attend: Temporal Localisation in Sign Language Videos ...
BASE
Show details
5
Visual Keyword Spotting with Attention ...
BASE
Show details
6
Aligning Subtitles in Sign Language Videos ...
BASE
Show details
7
BBC-Oxford British Sign Language Dataset ...
BASE
Show details
8
BSL-1K: Scaling up co-articulated sign language recognition using mouthing cues
In: European Conference on Computer Vision (ECCV) 2020 ; https://hal.archives-ouvertes.fr/hal-03516489 ; European Conference on Computer Vision (ECCV) 2020, Aug 2020, Glasgow, United Kingdom. ⟨10.1007/978-3-030-58621-8_3⟩ (2020)
BASE
Show details
9
Watch, read and lookup: learning to spot signs from multiple supervisors
In: Asian Conference on Computer Vision (ACCV) 2020 ; https://hal.archives-ouvertes.fr/hal-03516457 ; Asian Conference on Computer Vision (ACCV) 2020, Nov 2020, Kyoto, Japan. ⟨10.1007/978-3-030-69544-6_18⟩ (2020)
BASE
Show details
10
Watch, read and lookup: learning to spot signs from multiple supervisors ...
BASE
Show details
11
BSL-1K: Scaling up co-articulated sign language recognition using mouthing cues ...
BASE
Show details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
11
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern