| 1 |
Developing semantic knowledge through cross-situational word learning
|
|
|
|
In: http://www.kachergis.com/docs/kachergis_yu_shiffrin_2014_priming.pdf (2014)
|
|
BASE
|
|
Show details
|
|
|
| 2 |
Reviewed by:
|
|
|
|
In: http://www.kachergis.com/docs/kachergis_yu_shiffrin_2014frontiers_implicit.pdf (2014)
|
|
BASE
|
|
Show details
|
|
|
| 3 |
Actively learning object names across ambiguous situations
|
|
|
|
In: http://www.kachergis.com/docs/kachergis_etal2013_active.pdf (2013)
|
|
BASE
|
|
Show details
|
|
|
| 4 |
Does Statistical Word Learning Scale? It’s a Matter of Perspective
|
|
|
|
In: http://www.thoughtfill.com/docs/yurovsky_smith_yu_cs12.pdf (2012)
|
|
BASE
|
|
Show details
|
|
|
| 5 |
Actively Learning Object Names Across Ambiguous Situations
|
|
|
|
In: http://www.indiana.edu/~dll/papers/kachergis2012_active_topics.pdf (2012)
|
|
BASE
|
|
Show details
|
|
|
| 6 |
Joint or conditional probability in statistical word learning: Why decide
|
|
|
|
In: http://141.14.165.6/CogSci09/papers/676/paper676.pdf (2009)
|
|
BASE
|
|
Show details
|
|
|
| 7 |
Frequency and contextual diversity effects in cross-situational word learning
|
|
|
|
In: http://141.14.165.6/CogSci09/papers/521/paper521.pdf (2009)
|
|
BASE
|
|
Show details
|
|
|
| 8 |
Prior knowledge bootstraps cross-situational learning
|
|
|
|
In: http://csjarchive.cogsci.rpi.edu/Proceedings/2008/pdfs/p1930.pdf (2008)
|
|
BASE
|
|
Show details
|
|
|
| 9 |
Infants rapidly learn words from noisy data via cross-situational statistics
|
|
|
|
In: http://csjarchive.cogsci.rpi.edu/proceedings/2007/docs/p653.pdf (2007)
|
|
BASE
|
|
Show details
|
|
|
| 10 |
Infants rapidly learn word-referent mappings via cross-situational statistics
|
|
|
|
In: http://www.indiana.edu/~dll/papers/COGNIT_1702.pdf (2007)
|
|
BASE
|
|
Show details
|
|
|
| 11 |
The Role of Embodied Intention in Early Lexical Acquisition
|
|
|
|
In: http://www.cs.utexas.edu/~kuipers/readings/Yu-cogsci-05.pdf (2005)
|
|
BASE
|
|
Show details
|
|
|
| 12 |
A multimodal learning interface for grounding spoken language in sensory perceptions
|
|
|
|
In: http://www.indiana.edu/~dll/papers/yu_tap04.pdf (2004)
|
|
BASE
|
|
Show details
|
|
|
| 13 |
A Multimodal Learning Interface for Grounding Spoken Language in Sensory Perceptions
|
|
|
|
In: http://www.cs.rochester.edu/~yu/pubs/yu_icmi03.pdf (2004)
|
|
Abstract:
Most speech interfaces are based on natural language processing techniques that use pre-defined symbolic representations of word meanings and process only linguistic information. To understand and use language like their human counterparts in multimodal humancomputer interaction, computers need to acquire spoken language and map it to other sensory perceptions. This paper presents a multimodal interface that learns to associate spoken language with perceptual features by being situated in users' everyday environments and sharing user-centric multisensory information. The learning interface is trained in unsupervised mode in which users perform everyday tasks while providing natural language descriptions of their behaviors. We collect acoustic signals in concert with multisensory information from non-speech modalities, such as user's perspective video, gaze positions, head directions and hand movements. The system firstly estimates users' focus of attention from eye and head cues. Attention, as represented by gaze fixation, is used for spotting the target object of user interest. Attention switches are calculated and used to segment an action sequence into action units which are then categorized by mixture hidden Markov models. A multimodal learning algorithm is developed to spot words from continuous speech and then associate them with perceptually grounded meanings extracted from visual perception and action. Successful learning has been demonstrated in the experiments of three natural tasks: "unscrewing a jar", "stapling a letter" and "pouring water".
|
|
Keyword:
Human Factors Keywords Language Acquisition; Languages; Machine Learning; Multimodal Integration
|
|
URL: http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.10.7352
http://www.cs.rochester.edu/~yu/pubs/yu_icmi03.pdf
|
|
BASE
|
|
Hide details
|
|
|
| 14 |
Cross-Situational Statistical Learning: Implicit or Intentional?
|
|
|
|
In: http://www.indiana.edu/%7Edll/papers/george_implicit_revised.pdf
|
|
BASE
|
|
Show details
|
|
|
| 15 |
Adaptive Constraints and Inference in Cross-Situational Word Learning
|
|
|
|
In: http://www.indiana.edu/%7Edll/papers/george_adaptive_revised.pdf
|
|
BASE
|
|
Show details
|
|
|
| 16 |
Joint or Conditional Probability in Statistical Word Learning: Why decide?
|
|
|
|
In: http://www.indiana.edu/~dll/papers/KleinYuCogSci09.pdf
|
|
BASE
|
|
Show details
|
|
|
| 17 |
Frequency and Contextual Diversity Effects in Cross-Situational Word Learning
|
|
|
|
In: http://www.indiana.edu/~dll/papers/kachergis_cont_div_freq09.pdf
|
|
BASE
|
|
Show details
|
|
|
| 18 |
Running head: PARTIAL KNOWLEDGE 1 The Role of Partial Knowledge in Statistical Word Learning
|
|
|
|
In: http://www.iub.edu/~cogdev/labwork/yurovsky_fricker_yu_smith.pdf
|
|
BASE
|
|
Show details
|
|
|
| 19 |
Please address correspondence to:
|
|
|
|
In: http://www.indiana.edu/~dll/papers/yurovsky_smith_yu_ds12.pdf
|
|
BASE
|
|
Show details
|
|
|
|
|
