Home Catalogue search

eng

Refine your search:

Search in the Catalogues and Directories






	Sort by
Simple Search

Page: 1 2

Hits 1 – 20 of 40

1	Multimodal Lip-Reading for Tracheostomy Patients in the Greek Language
	Yorghos Voutos; Georgios Drakopoulos; Georgios Chrysovitsiotis; Zoi Zachou; Dimitris Kikidis; Efthymios Kyrodimos; Themis Exarchos
	In: Computers; Volume 11; Issue 3; Pages: 34 (2022)
	BASE
	Show details

2	Semantic Fusion for Natural Multimodal Interfaces using Concurrent Augmented Transition Networks
	Chris Zimmerer; Martin Fischbach; Marc Latoschik
	In: Multimodal Technologies and Interaction ; Volume 2 ; Issue 4 (2018)
	Abstract: Semantic fusion is a central requirement of many multimodal interfaces. Procedural methods like finite-state transducers and augmented transition networks have proven to be beneficial to implement semantic fusion. They are compliant with rapid development cycles that are common for the development of user interfaces, in contrast to machine-learning approaches that require time-costly training and optimization. We identify seven fundamental requirements for the implementation of semantic fusion: Action derivation, continuous feedback, context-sensitivity, temporal relation support, access to the interaction context, as well as the support of chronologically unsorted and probabilistic input. A subsequent analysis reveals, however, that there is currently no solution for fulfilling the latter two requirements. As the main contribution of this article, we thus present the Concurrent Cursor concept to compensate these shortcomings. In addition, we showcase a reference implementation, the Concurrent Augmented Transition Network (cATN), that validates the concept’s feasibility in a series of proof of concept demonstrations as well as through a comparative benchmark. The cATN fulfills all identified requirements and fills the lack amongst previous solutions. It supports the rapid prototyping of multimodal interfaces by means of five concrete traits: Its declarative nature, the recursiveness of the underlying transition network, the network abstraction constructs of its description language, the utilized semantic queries, and an abstraction layer for lexical information. Our reference implementation was and is used in various student projects, theses, as well as master-level courses. It is openly available and showcases that non-experts can effectively implement multimodal interfaces, even for non-trivial applications in mixed and virtual reality.
	Keyword: human‒computer interaction; multimodal fusion; multimodal interface; natural interfaces; procedural fusion methods; semantic fusion
	URL: https://doi.org/10.3390/mti2040081
	BASE
	Hide details

3	Mining a Multimodal Corpus of Doctor's Training for Virtual Patient's Feedbacks
	Porhet, Chris; Ochs, Magalie; Saubesty, Jorane...
	In: 19th International Conference on Multimodal Interaction (ICMI) ; https://hal.archives-ouvertes.fr/hal-01654812 ; 19th International Conference on Multimodal Interaction (ICMI), Nov 2017, Glasgow, United Kingdom. ⟨10.1145/3136755.3136816⟩ (2017)
	BASE
	Show details

4	ENHANCING EXPRESSIVITY OF DOCUMENT-CENTERED COLLABORATION WITH MULTIMODAL ANNOTATIONS
	Yoon, Dongwook. - 2017
	BASE
	Show details

5	ДВУЯЗЫЧНАЯ МНОГОМОДАЛЬНАЯ СИСТЕМА ДЛЯ АУДИОВИЗУАЛЬНОГО СИНТЕЗА РЕЧИ И ЖЕСТОВОГО ЯЗЫКА ПО ТЕКСТУ
	КАРПОВ АЛЕКСЕЙ АНАТОЛЬЕВИЧ; ЖЕЛЕЗНЫ МИЛОШ. - : Федеральное государственное автономное образовательное учреждение высшего образования «Санкт-Петербургский национальный исследовательский университет информационных технологий, механики и оптики», 2014
	BASE
	Show details

6	Robust Multimodal Cognitive Load Measurement
	Chen, Fang
	In: DTIC (2014)
	BASE
	Show details

7	Robust Multimodal Cognitive Load Measurement (RMCLM)
	Chen, Fang
	In: DTIC (2013)
	BASE
	Show details

8	Interactive multi-modal question-answering
	Bosch, Antal van den; Bouma, Gosse. - Berlin : Springer, 2011
	MPI für Psycholinguistik
	Show details

9	Effective and Spurious Ambiguities due to some Co-verbal Gestures in multimodal dialogue
	Landragin, Frédéric
	In: Eighth International Gesture Workshop (GW 2009) ; https://halshs.archives-ouvertes.fr/halshs-00436903 ; Eighth International Gesture Workshop (GW 2009), Feb 2009, Bielefeld, Germany (2009)
	BASE
	Show details

10	Between linguistic attention and gaze fixations in multimodal conversational interfaces
	Rui Fang; Joyce Y. Chai; Fernanda Ferreira
	In: http://web.cse.msu.edu/~fangrui/Papers/ICMI09.pdf (2009)
	BASE
	Show details

11	Ishizuka M.: Automatic generation of gaze and gestures for dialogues between embodied conversational agents
	Werner Breitfuss; W. Breitfuss; H. Prendinger...
	In: http://research.nii.ac.jp/%7Eprendinger/papers/werner-helmut-IJSC-08.pdf (2008)
	BASE
	Show details

12	Multi modal gesture identification for HCI using surface EMG
	Naik, Ganesh R. (R19010); Kumar, Dinesh K.; Arjunan, Sridhar P.. - : U.S., Association for Computing Machinery, 2008
	BASE
	Show details

13	Timing of visual and spoken input in robot instructions
	Joerg Wolf; Guido Bugmann
	In: http://www.swrtec.de/swrtec/research/publications/WolfBugmannsubmissionv3.pdf (2006)
	BASE
	Show details

14	Using redundant speech and handwriting for learning new vocabulary and understanding abbreviations
	Edward C. Kaiser
	In: https://pal.sri.com/CALOfiles/cstore/PAL-publications/calo/2006/p347-kaiser.pdf (2006)
	BASE
	Show details

15	Collaborative multimodal photo annotation over digital paper
	Paulo Barthelmess; Edward Kaiser; Xiao Huang...
	In: http://pdf.aminer.org/000/334/219/collaborative_multimodal_photo_annotation_over_digital_paper.pdf (2006)
	BASE
	Show details

16	Effective error recovery strategies for multimodal form-filling applications
	Janienke Sturm; Lou Boves
	In: http://lands.let.kun.nl/literature/sturm.2005.1.pdf (2005)
	BASE
	Show details

17	Distributed pointing for multimodal collaboration over sketched diagrams
	Paulo Barthelmess; Xiao Huang
	In: http://calosystem.com/publications/downloads/kaiser/distpointingmultimodal-kaiser.pdf (2005)
	BASE
	Show details

18	Distributed Pointing for Multimodal Collaboration Over Sketched Diagrams. ICMI
	Paulo Barthelmess; Xiao Huang; David Demirdjian
	In: http://www.barthelmess.net/Publications/ICMI/p10-barthelmess.pdf (2005)
	BASE
	Show details

19	Linguistic theories in efficient multimodal reference resolution: An empirical investigation
	Joyce Y. Chai; Zahar Prasov; Joseph Blaim...
	In: http://www.soc.northwestern.edu/justine/discourse07/week2/Chai_LinguisticTheories.pdf (2005)
	BASE
	Show details

20	Multimodal new vocabulary recognition through speech and handwriting in a whiteboard scheduling application
	Edward C. Kaiser
	In: http://www.cse.ogi.edu/CHCC/Publications/Multimodal_New_Vocabulary_Recognition_through_Speech_and_Handwriting_in_a_Whiteboard_Scheduling_Application.pdf (2005)
	BASE
	Show details

Page: 1 2

© 2013 - 2024 Lin|gu|is|tik | Imprint | Privacy Policy | Datenschutzeinstellungen ändern