| 21 |
Which Input Abstraction is Better for a Robot Syntax Acquisition Model? Phonemes, Words or Grammatical Constructions?
|
|
|
|
In: 2018 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) ; https://hal.inria.fr/hal-01889919 ; 2018 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Sep 2018, Tokyo, Japan (2018)
|
|
BASE
|
|
Show details
|
|
|
| 22 |
From Phonemes to Sentence Comprehension: A Neurocomputational Model of Sentence Processing for Robots
|
|
|
|
In: SBDM2018 Satellite-Workshop on interfaces between Robotics, Artificial Intelligence and Neuroscience ; https://hal.inria.fr/hal-01964524 ; SBDM2018 Satellite-Workshop on interfaces between Robotics, Artificial Intelligence and Neuroscience, May 2018, Paris, France (2018)
|
|
BASE
|
|
Show details
|
|
|
| 23 |
Neural coding of variable song structure in the songbird
|
|
|
|
In: EBM 2017 - European Birdsong Meeting ; https://hal.inria.fr/hal-01665824 ; EBM 2017 - European Birdsong Meeting, May 2017, Bordeaux, France. pp.1 ; https://birdsong2017.sciencesconf.org/ (2017)
|
|
BASE
|
|
Show details
|
|
|
| 24 |
From Phonemes to Robot Commands with a Neural Parser
|
|
|
|
In: IEEE ICDL-EPIROB Workshop on Language Learning ; https://hal.inria.fr/hal-01665823 ; IEEE ICDL-EPIROB Workshop on Language Learning, Sep 2017, Lisbon, Portugal. pp.1-2 (2017)
|
|
Abstract:
International audience ; The understanding of how children acquire language [1][2], from phoneme to syntax, could be improved by computational models. In particular when they are integrated in robots [3]: e.g. by interacting with users [4] or grounding language cues [5]. Recently, speech recognition systems have greatly improved thanks to deep learning. However, for specific domain applications, like Human-Robot Interaction, using generic recognition tools such as Google API often provide words that are unknown by the robotic system when not just irrelevant [6]. Additionally, such recognition system does not provide much indications on how our brains acquire or process these phonemes, words or grammatical constructions (i.e. sentence templates). Moreover, to our knowledge they do not provide useful tools to learn from small corpora, from which a child may bootstrap from. Here, we propose a neuro-inspired approach that processes sentences word by word, or phoneme by phoneme, with no prior knowledge of the semantics of the words. Previously, we demonstrated this RNN-based model was able to generalize on grammatical constructions [7] even with unknown words (i.e. words out of the vocabulary of the training data) [8]. In this preliminary study, in order to try to overcome word misrecognition, we tested whether the same architecture is able to solve the same task directly by processing phonemes instead of grammatical constructions [9]. Applied on a small corpus, we see that the model has similar performance (even if a little weaker) when using phonemes as inputs instead of grammatical constructions. We speculate that this phoneme version could overcome the previous model when dealing with real noisy phoneme inputs, thus improving its performance in a real-time human-robot interaction.
|
|
Keyword:
[INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG]; [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE]; [INFO.INFO-RB]Computer Science [cs]/Robotics [cs.RO]; [SCCO.LING]Cognitive science/Linguistics
|
|
URL: https://hal.inria.fr/hal-01665823/file/Camera_ready_Hinaut_WS_language-learning-ICDLepirob2017.pdf
https://hal.inria.fr/hal-01665823/document
https://hal.inria.fr/hal-01665823
|
|
BASE
|
|
Hide details
|
|
|
| 25 |
Modelling sentence processing with random recurrent neural networks and applications to robotics
|
|
|
|
In: Workshop "The role of the basal ganglia in the interaction between language and other cognitive functions" ; https://hal.inria.fr/hal-01673440 ; Workshop "The role of the basal ganglia in the interaction between language and other cognitive functions", Anne-Catherine Bachoud-Lévi, Maria Giavazzi, Charlotte Jacquemot, Laboratoire de NeuroPsychologie Interventionnelle., Oct 2017, Paris, France ; http://www.ens.fr/agenda/role-basal-ganglia-interaction-between-language-and-other-cognitive-functions/2017-10 (2017)
|
|
BASE
|
|
Show details
|
|
|
| 26 |
Syntactic Reanalysis in Language Models for Speech Recognition
|
|
|
|
In: 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) ; https://hal.inria.fr/hal-01558462 ; 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Sep 2017, Lisbon, Portugal ; http://icdl-epirob.org/ (2017)
|
|
BASE
|
|
Show details
|
|
|
| 27 |
Teach Your Robot Your Language! Trainable Neural Parser for Modelling Human Sentence Processing: Examples for 15 Languages
|
|
|
|
In: https://hal.inria.fr/hal-01665807 ; 2017 (2017)
|
|
BASE
|
|
Show details
|
|
|
| 28 |
Recurrent Neural Network for Syntax Learning with Flexible Predicates for Robotic Architectures
|
|
|
|
In: The Sixth Joint IEEE International Conference Developmental Learning and Epigenetic Robotics (ICDL-EPIROB) ; https://hal.inria.fr/hal-01417697 ; The Sixth Joint IEEE International Conference Developmental Learning and Epigenetic Robotics (ICDL-EPIROB), Sep 2016, Cergy, France ; http://icdl-epirob.org/ (2016)
|
|
BASE
|
|
Show details
|
|
|
| 29 |
Recurrent Neural Network for Syntax Learning with Flexible Representations
|
|
|
|
In: IEEE ICDL-EPIROB Workshop on Language Learning ; https://hal.inria.fr/hal-01417060 ; IEEE ICDL-EPIROB Workshop on Language Learning, Dec 2016, Cergy, France ; https://sites.google.com/site/epirob2016language/ (2016)
|
|
BASE
|
|
Show details
|
|
|
| 30 |
Reservoir Computing for Robot Language Acquisition
|
|
|
|
In: IROS Workshop on Machine Learning Methods for High-Level Cognitive Capabilities in Robotics ; https://hal.inria.fr/hal-01417683 ; IROS Workshop on Machine Learning Methods for High-Level Cognitive Capabilities in Robotics, Oct 2016, Daejon, South Korea ; http://mlhlcr2016.tanichu.com/home (2016)
|
|
BASE
|
|
Show details
|
|
|
| 31 |
Recurrent Neural Network Sentence Parser for Multiple Languages with Flexible Meaning Representations for Home Scenarios
|
|
|
|
In: IROS Workshop on Bio-inspired Social Robot Learning in Home Scenarios ; https://hal.inria.fr/hal-01417667 ; IROS Workshop on Bio-inspired Social Robot Learning in Home Scenarios, Oct 2016, Daejon, South Korea ; https://www.informatik.uni-hamburg.de/wtm/SocialRobotsWorkshop2016/index.php (2016)
|
|
BASE
|
|
Show details
|
|
|
| 32 |
Semantic Role Labelling for Robot Instructions using Echo State Networks
|
|
|
|
In: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN) ; https://hal.inria.fr/hal-01417701 ; European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN), Apr 2016, Bruges, Belgium ; https://www.elen.ucl.ac.be/esann/index.php?pg=esann16_programme (2016)
|
|
BASE
|
|
Show details
|
|
|
| 33 |
Using Natural Language Feedback in a Neuro-inspired Integrated Multimodal Robotic Architecture
|
|
|
|
In: 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) ; https://hal.inria.fr/hal-01417706 ; 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Aug 2016, New York City, United States. pp.52 - 57, ⟨10.1109/ROMAN.2016.7745090⟩ ; http://www.tc.columbia.edu/conferences/roman2016/ (2016)
|
|
BASE
|
|
Show details
|
|
|
| 34 |
A Recurrent Neural Network for Multiple Language Acquisition: Starting with English and French
|
|
|
|
In: Proceedings of the NIPS Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (CoCo 2015) ; https://hal.inria.fr/hal-02561258 ; Proceedings of the NIPS Workshop on Cognitive Computation: Integrating Neural and Symbolic Approaches (CoCo 2015), Dec 2015, Montreal, Canada ; http://ceur-ws.org/Vol-1583/ (2015)
|
|
BASE
|
|
Show details
|
|
|
| 35 |
Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks
|
|
|
|
In: ISSN: 1662-5218 ; EISSN: 1662-5218 ; Frontiers in Neurorobotics ; https://hal.inria.fr/hal-02383530 ; Frontiers in Neurorobotics, Frontiers, 2014, 8, ⟨10.3389/fnbot.2014.00016⟩ (2014)
|
|
BASE
|
|
Show details
|
|
|
| 36 |
Exploring the acquisition and production of grammatical constructions through human-robot interaction with echo state networks
|
|
|
|
BASE
|
|
Show details
|
|
|
| 37 |
On-Line Learning of Lexical Items and Grammatical Constructions via Speech, Gaze and Action-Based Human-Robot Interaction
|
|
|
|
In: INTERSPEECH 2013 - 14th Annual Conference of the International Speech Communication Association ; https://hal.inria.fr/hal-02561340 ; INTERSPEECH 2013 - 14th Annual Conference of the International Speech Communication Association, Aug 2013, Lyon, France ; https://www.isca-speech.org/archive/interspeech_2013/i13_2657.html (2013)
|
|
BASE
|
|
Show details
|
|
|
| 38 |
Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir Computing
|
|
|
|
In: ISSN: 1932-6203 ; EISSN: 1932-6203 ; PLoS ONE ; https://hal.inria.fr/hal-01968923 ; PLoS ONE, Public Library of Science, 2013, 8 (2), pp.e52946. ⟨10.1371/journal.pone.0052946⟩ (2013)
|
|
BASE
|
|
Show details
|
|
|
| 39 |
Real-Time Parallel Processing of Grammatical Structure in the Fronto-Striatal System: A Recurrent Network Simulation Study Using Reservoir Computing
|
|
|
|
BASE
|
|
Show details
|
|
|
| 40 |
Online Language Learning to Perform and Describe Actions for Human-Robot Interaction
|
|
|
|
In: Post-Graduate Conference on Robotics and Development of Cognition ; https://hal.inria.fr/hal-02561346 ; Post-Graduate Conference on Robotics and Development of Cognition, Sep 2012, Lausanne, Switzerland (2012)
|
|
BASE
|
|
Show details
|
|
|
|
|
