DE eng

Search in the Catalogues and Directories

Hits 1 – 1 of 1

1
Visual Salience and Perceptual Grouping in Multimodal Interactivity
In: First International Workshop on Information Presentation and Natural Multimodal Dialogue ; https://halshs.archives-ouvertes.fr/inria-00100576 ; First International Workshop on Information Presentation and Natural Multimodal Dialogue, 2001, Verona, Italy. pp.151-155 (2001)
Abstract: This paper deals with the pragmatic interpretation of multimodal referring expressions in man-machine dialogue systems. We show the importance of building up a structure of the visual context at a semantic level, in order to enrich the significant possibilities of interpretations and to make possible the fusion of this structure with the ones obtained from the linguistic and gesture semantic analyses. Visual salience and perceptual grouping are two notions that guide such a structuring. We thus propose a hierarchy of salience criteria linked to an algorithm that detects salient objects, as well as guidelines for grouping algorithms. We show how the integration of the results of all these algorithms is a complex problem. We propose simple heuristics to reduce this complexity and we conclude on the usability of such heuristics in actual systems.
Keyword: [INFO.INFO-HC]Computer Science [cs]/Human-Computer Interaction [cs.HC]; [INFO.INFO-MM]Computer Science [cs]/Multimedia [cs.MM]; [SCCO.COMP]Cognitive science/Computer science; [SHS.INFO]Humanities and Social Sciences/Library and information sciences; context modeling; Gestalt theory; Multimodal interaction; perceptual grouping; visual perception; visual salience
URL: https://halshs.archives-ouvertes.fr/inria-00100576
https://halshs.archives-ouvertes.fr/inria-00100576v2/document
https://halshs.archives-ouvertes.fr/inria-00100576v2/file/landragin.pdf
BASE
Hide details

Catalogues
0
0
0
0
0
0
0
Bibliographies
0
0
0
0
0
0
0
0
0
Linked Open Data catalogues
0
Online resources
0
0
0
0
Open access documents
1
0
0
0
0
© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern