Home
Catalogue search
Refine your search:
Keyword
Creator / Publisher:
Afouras, Triantafyllos (4)
Albanie, Samuel (4)
Bull, Hannah (4)
Momeni, Liliane (4)
Varol, Gül (4)
Zisserman, Andrew (4)
CentraleSupélec-Université Paris-Saclay-Centre National de la Recherche Scientifique (CNRS) (2)
Chowdhury, Himel (2)
Cooper, Rob (2)
Fox, Neil (2)
more
Year:
2022 (1)
2021 (3)
Medium:
Online (4)
Type:
Miscellaneous (3)
Article (1)
BLLDB-Access
Search in the Catalogues and Directories
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
AND
OR
AND NOT
All fields
Title
Creator / Publisher
Keyword
Year
Sort by
creator [A → Z]
'
creator [Z → A]
'
publishing year ↑ (asc)
'
publishing year ↓ (desc)
'
title [A → Z]
'
title [Z → A]
'
Simple Search
Hits 1 – 4 of 4
1
BBC-Oxford British Sign Language Dataset
Albanie, Samuel
;
Varol, Gül
;
Momeni, Liliane
...
In: https://hal.archives-ouvertes.fr/hal-03516444 ; 2022 (2022)
BASE
Show details
2
Aligning Subtitles in Sign Language Videos
Bull, Hannah
;
Afouras, Triantafyllos
;
Varol, Gül
;
Albanie, Samuel
;
Momeni, Liliane
;
Zisserman, Andrew
In: International Conference on Computer Vision (ICCV) ; https://hal.archives-ouvertes.fr/hal-03515983 ; International Conference on Computer Vision (ICCV), Oct 2021, Montreal, Canada (2021)
Abstract:
International audience ; The goal of this work is to temporally align asynchronous subtitles in sign language videos. In particular, we focus on sign-language interpreted TV broadcast data comprising (i) a video of continuous signing, and (ii) subtitles corresponding to the audio content. Previous work exploiting such weakly-aligned data only considered finding keyword-sign correspondences, whereas we aim to localise a complete subtitle text in continuous signing. We propose a Transformer architecture tailored for this task, which we train on manually annotated alignments covering over 15K subtitles that span 17.7 hours of video. We use BERT subtitle embeddings and CNN video representations learned for sign recognition to encode the two signals, which interact through a series of attention layers. Our model outputs frame-level predictions, i.e., for each video frame, whether it belongs to the queried subtitle or not. Through extensive evaluations, we show substantial improvements over existing alignment baselines that do not make use of subtitle text embeddings for learning. Our automatic alignment model opens up possibilities for advancing machine translation of sign languages via providing continuously synchronized video-text data.
Keyword:
[INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]
;
[INFO.INFO-CV]Computer Science [cs]/Computer Vision and Pattern Recognition [cs.CV]
;
[INFO]Computer Science [cs]
URL:
https://hal.archives-ouvertes.fr/hal-03515983
BASE
Hide details
3
Aligning Subtitles in Sign Language Videos ...
Bull, Hannah
;
Afouras, Triantafyllos
;
Varol, Gül
. - : arXiv, 2021
BASE
Show details
4
BBC-Oxford British Sign Language Dataset ...
Albanie, Samuel
;
Varol, Gül
;
Momeni, Liliane
. - : arXiv, 2021
BASE
Show details
Mobile view
All
Catalogues
UB Frankfurt Linguistik
0
IDS Mannheim
0
OLC Linguistik
0
UB Frankfurt Retrokatalog
0
DNB Subject Category Language
0
Institut für Empirische Sprachwissenschaft
0
Leibniz-Centre General Linguistics (ZAS)
0
Bibliographies
BLLDB
0
BDSL
0
IDS Bibliografie zur deutschen Grammatik
0
IDS Bibliografie zur Gesprächsforschung
0
IDS Konnektoren im Deutschen
0
IDS Präpositionen im Deutschen
0
IDS OBELEX meta
0
MPI-SHH Linguistics Collection
0
MPI for Psycholinguistics
0
Linked Open Data catalogues
Annohub
0
Online resources
Link directory
0
Journal directory
0
Database directory
0
Dictionary directory
0
Open access documents
BASE
4
Linguistik-Repository
0
IDS Publikationsserver
0
Online dissertations
0
Language Description Heritage
0
© 2013 - 2024 Lin|gu|is|tik
|
Imprint
|
Privacy Policy
|
Datenschutzeinstellungen ändern