21 |
Which Input Abstraction is Better for a Robot Syntax Acquisition Model? Phonemes, Words or Grammatical Constructions?
|
|
|
|
In: 2018 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) ; https://hal.inria.fr/hal-01889919 ; 2018 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Sep 2018, Tokyo, Japan (2018)
|
|
BASE
|
|
Show details
|
|
22 |
From Phonemes to Sentence Comprehension: A Neurocomputational Model of Sentence Processing for Robots
|
|
|
|
In: SBDM2018 Satellite-Workshop on interfaces between Robotics, Artificial Intelligence and Neuroscience ; https://hal.inria.fr/hal-01964524 ; SBDM2018 Satellite-Workshop on interfaces between Robotics, Artificial Intelligence and Neuroscience, May 2018, Paris, France (2018)
|
|
BASE
|
|
Show details
|
|
23 |
Neural coding of variable song structure in the songbird
|
|
|
|
In: EBM 2017 - European Birdsong Meeting ; https://hal.inria.fr/hal-01665824 ; EBM 2017 - European Birdsong Meeting, May 2017, Bordeaux, France. pp.1 ; https://birdsong2017.sciencesconf.org/ (2017)
|
|
BASE
|
|
Show details
|
|
24 |
From Phonemes to Robot Commands with a Neural Parser
|
|
|
|
In: IEEE ICDL-EPIROB Workshop on Language Learning ; https://hal.inria.fr/hal-01665823 ; IEEE ICDL-EPIROB Workshop on Language Learning, Sep 2017, Lisbon, Portugal. pp.1-2 (2017)
|
|
BASE
|
|
Show details
|
|
25 |
Modelling sentence processing with random recurrent neural networks and applications to robotics
|
|
|
|
In: Workshop "The role of the basal ganglia in the interaction between language and other cognitive functions" ; https://hal.inria.fr/hal-01673440 ; Workshop "The role of the basal ganglia in the interaction between language and other cognitive functions", Anne-Catherine Bachoud-Lévi, Maria Giavazzi, Charlotte Jacquemot, Laboratoire de NeuroPsychologie Interventionnelle., Oct 2017, Paris, France ; http://www.ens.fr/agenda/role-basal-ganglia-interaction-between-language-and-other-cognitive-functions/2017-10 (2017)
|
|
BASE
|
|
Show details
|
|
26 |
Syntactic Reanalysis in Language Models for Speech Recognition
|
|
|
|
In: 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) ; https://hal.inria.fr/hal-01558462 ; 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Sep 2017, Lisbon, Portugal ; http://icdl-epirob.org/ (2017)
|
|
BASE
|
|
Show details
|
|
27 |
Teach Your Robot Your Language! Trainable Neural Parser for Modelling Human Sentence Processing: Examples for 15 Languages
|
|
|
|
In: https://hal.inria.fr/hal-01665807 ; 2017 (2017)
|
|
BASE
|
|
Show details
|
|
28 |
Recurrent Neural Network for Syntax Learning with Flexible Predicates for Robotic Architectures
|
|
|
|
In: The Sixth Joint IEEE International Conference Developmental Learning and Epigenetic Robotics (ICDL-EPIROB) ; https://hal.inria.fr/hal-01417697 ; The Sixth Joint IEEE International Conference Developmental Learning and Epigenetic Robotics (ICDL-EPIROB), Sep 2016, Cergy, France ; http://icdl-epirob.org/ (2016)
|
|
BASE
|
|
Show details
|
|
29 |
Recurrent Neural Network for Syntax Learning with Flexible Representations
|
|
|
|
In: IEEE ICDL-EPIROB Workshop on Language Learning ; https://hal.inria.fr/hal-01417060 ; IEEE ICDL-EPIROB Workshop on Language Learning, Dec 2016, Cergy, France ; https://sites.google.com/site/epirob2016language/ (2016)
|
|
BASE
|
|
Show details
|
|
30 |
Reservoir Computing for Robot Language Acquisition
|
|
|
|
In: IROS Workshop on Machine Learning Methods for High-Level Cognitive Capabilities in Robotics ; https://hal.inria.fr/hal-01417683 ; IROS Workshop on Machine Learning Methods for High-Level Cognitive Capabilities in Robotics, Oct 2016, Daejon, South Korea ; http://mlhlcr2016.tanichu.com/home (2016)
|
|
BASE
|
|
Show details
|
|
31 |
Recurrent Neural Network Sentence Parser for Multiple Languages with Flexible Meaning Representations for Home Scenarios
|
|
|
|
In: IROS Workshop on Bio-inspired Social Robot Learning in Home Scenarios ; https://hal.inria.fr/hal-01417667 ; IROS Workshop on Bio-inspired Social Robot Learning in Home Scenarios, Oct 2016, Daejon, South Korea ; https://www.informatik.uni-hamburg.de/wtm/SocialRobotsWorkshop2016/index.php (2016)
|
|
BASE
|
|
Show details
|
|
32 |
Semantic Role Labelling for Robot Instructions using Echo State Networks
|
|
|
|
In: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN) ; https://hal.inria.fr/hal-01417701 ; European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), Apr 2016, Bruges, Belgium ; https://www.elen.ucl.ac.be/esann/index.php?pg=esann16_programme (2016)
|
|
BASE
|
|
Show details
|
|
33 |
Using Natural Language Feedback in a Neuro-inspired Integrated Multimodal Robotic Architecture
|
|
|
|
In: 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) ; https://hal.inria.fr/hal-01417706 ; 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Aug 2016, New York City, United States. pp.52 - 57, ⟨10.1109/ROMAN.2016.7745090⟩ ; http://www.tc.columbia.edu/conferences/roman2016/ (2016)
|
|
BASE
|
|
Show details
|
|
34 |
A Recurrent Neural Network for Multiple Language Acquisition: Starting with English and French
|
|
|
|
In: Proceedings of the NIPS Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (CoCo 2015) ; https://hal.inria.fr/hal-02561258 ; Proceedings of the NIPS Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (CoCo 2015), Dec 2015, Montreal, Canada ; http://ceur-ws.org/Vol-1583/ (2015)
|
|
BASE
|
|
Show details
|
|
35 |
Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks
|
|
|
|
In: ISSN: 1662-5218 ; EISSN: 1662-5218 ; Frontiers in Neurorobotics ; https://hal.inria.fr/hal-02383530 ; Frontiers in Neurorobotics, Frontiers, 2014, 8, ⟨10.3389/fnbot.2014.00016⟩ (2014)
|
|
BASE
|
|
Show details
|
|
36 |
Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks
|
|
|
|
BASE
|
|
Show details
|
|
37 |
On-Line Learning of Lexical Items and Grammatical Constructions via Speech, Gaze and Action-Based Human-Robot Interaction
|
|
|
|
In: INTERSPEECH 2013 - 14th Annual Conference of the International Speech Communication Association ; https://hal.inria.fr/hal-02561340 ; INTERSPEECH 2013 - 14th Annual Conference of the International Speech Communication Association, Aug 2013, Lyon, France ; https://www.isca-speech.org/archive/interspeech_2013/i13_2657.html (2013)
|
|
BASE
|
|
Show details
|
|
38 |
Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir Computing
|
|
|
|
In: ISSN: 1932-6203 ; EISSN: 1932-6203 ; PLoS ONE ; https://hal.inria.fr/hal-01968923 ; PLoS ONE, Public Library of Science, 2013, 8 (2), pp.e52946. ⟨10.1371/journal.pone.0052946⟩ (2013)
|
|
Abstract:
International audience ; Sentence processing takes place in real-time. Previous words in the sentence can influence the processing of the current word in the timescale of hundreds of milliseconds. Recent neurophysiological studies in humans suggest that the fronto-striatal system (frontal cortex, and striatum-the major input locus of the basal ganglia) plays a crucial role in this process. The current research provides a possible explanation of how certain aspects of this real-time processing can occur, based on the dynamics of recurrent cortical networks, and plasticity in the cortico-striatal system. We simulate prefrontal area BA47 as a recurrent network that receives on-line input about word categories during sentence processing, with plastic connections between cortex and striatum. We exploit the homology between the cortico-striatal system and reservoir computing, where recurrent frontal cortical networks are the reservoir, and plastic cortico-striatal synapses are the readout. The system is trained on sentence-meaning pairs, where meaning is coded as activation in the striatum corresponding to the roles that different nouns and verbs play in the sentences. The model learns an extended set of grammatical constructions, and demonstrates the ability to generalize to novel constructions. It demonstrates how early in the sentence, a parallel set of predictions are made concerning the meaning, which are then confirmed or updated as the processing of the input sentence proceeds. It demonstrates how on-line responses to words are influenced by previous words in the sentence, and by previous sentences in the discourse, providing new insight into the neurophysiology of the P600 ERP scalp response to grammatical complexity. This demonstrates that a recurrent neural network can decode grammatical structure from sentences in real-time in order to generate a predictive representation of the meaning of the sentences. This can provide insight into the underlying mechanisms of human cortico-striatal function in sentence processing. Citation: Hinaut X, Dominey PF (2013) Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir Computing. PLoS ONE 8(2): e52946.
|
|
Keyword:
[INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG]; [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE]; [SCCO.LING]Cognitive science/Linguistics; [SDV.NEU]Life Sciences [q-bio]/Neurons and Cognition [q-bio.NC]
|
|
URL: https://doi.org/10.1371/journal.pone.0052946 https://hal.inria.fr/hal-01968923/file/HinautDominey2013_journal.pone.0052946.pdf https://hal.inria.fr/hal-01968923 https://hal.inria.fr/hal-01968923/document
|
|
BASE
|
|
Hide details
|
|
39 |
Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir Computing
|
|
|
|
BASE
|
|
Show details
|
|
40 |
Online Language Learning to Perform and Describe Actions for Human-Robot Interaction
|
|
|
|
In: Post-Graduate Conference on Robotics and Development of Cognition ; https://hal.inria.fr/hal-02561346 ; Post-Graduate Conference on Robotics and Development of Cognition, Sep 2012, Lausanne, Switzerland (2012)
|
|
BASE
|
|
Show details
|
|
|
|