1 |
Cross-Situational Learning Towards Robot Grounding
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-03628290 ; 2022 (2022)
|
|
BASE
|
|
Show details
|
|
2 |
Cross-Situational Learning Towards Robot Grounding
|
|
|
|
In: https://hal.archives-ouvertes.fr/hal-03628290 ; 2022 (2022)
|
|
BASE
|
|
Show details
|
|
3 |
Hierarchical-Task Reservoir for Online Semantic Analysis from Continuous Speech
|
|
|
|
In: ISSN: 2162-237X ; IEEE Transactions on Neural Networks and Learning Systems ; https://hal.inria.fr/hal-03031413 ; IEEE Transactions on Neural Networks and Learning Systems, IEEE, 2021, ⟨10.1109/TNNLS.2021.3095140⟩ ; https://ieeexplore.ieee.org/abstract/document/9548713/metrics#metrics (2021)
|
|
BASE
|
|
Show details
|
|
4 |
Editorial: Language and Robotics
|
|
|
|
In: ISSN: 2296-9144 ; Frontiers in Robotics and AI ; https://hal.inria.fr/hal-03533733 ; Frontiers in Robotics and AI, Frontiers Media S.A., 2021, 8, ⟨10.3389/frobt.2021.674832⟩ (2021)
|
|
BASE
|
|
Show details
|
|
5 |
Cross-Situational Learning with Reservoir Computing for Language Acquisition Modelling
|
|
|
|
In: 2020 International Joint Conference on Neural Networks (IJCNN 2020) ; https://hal.inria.fr/hal-02594725 ; 2020 International Joint Conference on Neural Networks (IJCNN 2020), Jul 2020, Glasgow, Scotland, United Kingdom ; https://wcci2020.org/ (2020)
|
|
BASE
|
|
Show details
|
|
6 |
Language Acquisition with Echo State Networks: Towards Unsupervised Learning
|
|
|
|
In: ICDL 2020 - IEEE International Conference on Development and Learning ; https://hal.inria.fr/hal-02926613 ; ICDL 2020 - IEEE International Conference on Development and Learning, Oct 2020, Valparaiso / Virtual, Chile (2020)
|
|
BASE
|
|
Show details
|
|
7 |
A Journey in ESN and LSTM Visualisations on a Language Task
|
|
|
|
In: https://hal.inria.fr/hal-03030248 ; 2020 (2020)
|
|
BASE
|
|
Show details
|
|
8 |
Learning to Parse Grounded Language using Reservoir Computing
|
|
|
|
In: ICDL-Epirob 2019 - Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics ; https://hal.inria.fr/hal-02422157 ; ICDL-Epirob 2019 - Joint IEEE 9th International Conference on Development and Learning and Epigenetic Robotics, Aug 2019, Olso, Norway. ⟨10.1109/devlrn.2019.8850718⟩ ; https://ieeexplore.ieee.org/abstract/document/8850718 (2019)
|
|
BASE
|
|
Show details
|
|
9 |
Teach Your Robot Your Language! Trainable Neural Parser for Modelling Human Sentence Processing: Examples for 15 Languages
|
|
|
|
In: ISSN: 2379-8920 ; EISSN: 2379-8939 ; IEEE Transactions on Cognitive and Developmental Systems ; https://hal.inria.fr/hal-01964541 ; IEEE Transactions on Cognitive and Developmental Systems, Institute of Electrical and Electronics Engineers, Inc, 2019, ⟨10.1109/TCDS.2019.2957006⟩ ; https://doi.org/10.1109/tcds.2019.2957006 (2019)
|
|
BASE
|
|
Show details
|
|
10 |
A Reservoir Model for Intra-Sentential Code-Switching Comprehension in French and English
|
|
|
|
In: CogSci'19 - 41st Annual Meeting of the Cognitive Science Society ; https://hal.inria.fr/hal-02432831 ; CogSci'19 - 41st Annual Meeting of the Cognitive Science Society, Jul 2019, Montréal, Canada ; https://cognitivesciencesociety.org/cogsci-2019/ (2019)
|
|
BASE
|
|
Show details
|
|
11 |
Which Input Abstraction is Better for a Robot Syntax Acquisition Model? Phonemes, Words or Grammatical Constructions?
|
|
|
|
In: 2018 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) ; https://hal.inria.fr/hal-01889919 ; 2018 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Sep 2018, Tokyo, Japan (2018)
|
|
BASE
|
|
Show details
|
|
12 |
From Phonemes to Sentence Comprehension: A Neurocomputational Model of Sentence Processing for Robots
|
|
|
|
In: SBDM2018 Satellite-Workshop on interfaces between Robotics, Artificial Intelligence and Neuroscience ; https://hal.inria.fr/hal-01964524 ; SBDM2018 Satellite-Workshop on interfaces between Robotics, Artificial Intelligence and Neuroscience, May 2018, Paris, France (2018)
|
|
BASE
|
|
Show details
|
|
13 |
From Phonemes to Robot Commands with a Neural Parser
|
|
|
|
In: IEEE ICDL-EPIROB Workshop on Language Learning ; https://hal.inria.fr/hal-01665823 ; IEEE ICDL-EPIROB Workshop on Language Learning, Sep 2017, Lisbon, Portugal. pp.1-2 (2017)
|
|
Abstract:
International audience ; The understanding of how children acquire language [1][2], from phoneme to syntax, could be improved by computational models. In particular when they are integrated in robots [3]: e.g. by interacting with users [4] or grounding language cues [5]. Recently, speech recognition systems have greatly improved thanks to deep learning. However, for specific domain applications, like Human-Robot Interaction, using generic recognition tools such as Google API often provide words that are unknown by the robotic system when not just irrelevant [6]. Additionally, such recognition system does not provide much indications on how our brains acquire or process these phonemes, words or grammatical constructions (i.e. sentence templates). Moreover, to our knowledge they do not provide useful tools to learn from small corpora, from which a child may bootstrap from. Here, we propose a neuro-inspired approach that processes sentences word by word, or phoneme by phoneme, with no prior knowledge of the semantics of the words. Previously, we demonstrated this RNN-based model was able to generalize on grammatical constructions [7] even with unknown words (i.e. words out of the vocabulary of the training data) [8]. In this preliminary study, in order to try to overcome word misrecognition, we tested whether the same architecture is able to solve the same task directly by processing phonemes instead of grammatical constructions [9]. Applied on a small corpus, we see that the model has similar performance (even if a little weaker) when using phonemes as inputs instead of grammatical constructions. We speculate that this phoneme version could overcome the previous model when dealing with real noisy phoneme inputs, thus improving its performance in a real-time human-robot interaction.
|
|
Keyword:
[INFO.INFO-LG]Computer Science [cs]/Machine Learning [cs.LG]; [INFO.INFO-NE]Computer Science [cs]/Neural and Evolutionary Computing [cs.NE]; [INFO.INFO-RB]Computer Science [cs]/Robotics [cs.RO]; [SCCO.LING]Cognitive science/Linguistics
|
|
URL: https://hal.inria.fr/hal-01665823/file/Camera_ready_Hinaut_WS_language-learning-ICDLepirob2017.pdf https://hal.inria.fr/hal-01665823/document https://hal.inria.fr/hal-01665823
|
|
BASE
|
|
Hide details
|
|
14 |
Modelling sentence processing with random recurrent neural networks and applications to robotics
|
|
|
|
In: Workshop "The role of the basal ganglia in the interaction between language and other cognitive functions" ; https://hal.inria.fr/hal-01673440 ; Workshop "The role of the basal ganglia in the interaction between language and other cognitive functions", Anne-Catherine Bachoud-Lévi, Maria Giavazzi, Charlotte Jacquemot, Laboratoire de NeuroPsychologie Interventionnelle., Oct 2017, Paris, France ; http://www.ens.fr/agenda/role-basal-ganglia-interaction-between-language-and-other-cognitive-functions/2017-10 (2017)
|
|
BASE
|
|
Show details
|
|
15 |
Syntactic Reanalysis in Language Models for Speech Recognition
|
|
|
|
In: 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob) ; https://hal.inria.fr/hal-01558462 ; 2017 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob), Sep 2017, Lisbon, Portugal ; http://icdl-epirob.org/ (2017)
|
|
BASE
|
|
Show details
|
|
16 |
Teach Your Robot Your Language! Trainable Neural Parser for Modelling Human Sentence Processing: Examples for 15 Languages
|
|
|
|
In: https://hal.inria.fr/hal-01665807 ; 2017 (2017)
|
|
BASE
|
|
Show details
|
|
17 |
Recurrent Neural Network for Syntax Learning with Flexible Predicates for Robotic Architectures
|
|
|
|
In: The Sixth Joint IEEE International Conference Developmental Learning and Epigenetic Robotics (ICDL-EPIROB) ; https://hal.inria.fr/hal-01417697 ; The Sixth Joint IEEE International Conference Developmental Learning and Epigenetic Robotics (ICDL-EPIROB), Sep 2016, Cergy, France ; http://icdl-epirob.org/ (2016)
|
|
BASE
|
|
Show details
|
|
18 |
Recurrent Neural Network for Syntax Learning with Flexible Representations
|
|
|
|
In: IEEE ICDL-EPIROB Workshop on Language Learning ; https://hal.inria.fr/hal-01417060 ; IEEE ICDL-EPIROB Workshop on Language Learning, Dec 2016, Cergy, France ; https://sites.google.com/site/epirob2016language/ (2016)
|
|
BASE
|
|
Show details
|
|
19 |
Reservoir Computing for Robot Language Acquisition
|
|
|
|
In: IROS Workshop on Machine Learning Methods for High-Level Cognitive Capabilities in Robotics ; https://hal.inria.fr/hal-01417683 ; IROS Workshop on Machine Learning Methods for High-Level Cognitive Capabilities in Robotics, Oct 2016, Daejon, South Korea ; http://mlhlcr2016.tanichu.com/home (2016)
|
|
BASE
|
|
Show details
|
|
20 |
Recurrent Neural Network Sentence Parser for Multiple Languages with Flexible Meaning Representations for Home Scenarios
|
|
|
|
In: IROS Workshop on Bio-inspired Social Robot Learning in Home Scenarios ; https://hal.inria.fr/hal-01417667 ; IROS Workshop on Bio-inspired Social Robot Learning in Home Scenarios, Oct 2016, Daejon, South Korea ; https://www.informatik.uni-hamburg.de/wtm/SocialRobotsWorkshop2016/index.php (2016)
|
|
BASE
|
|
Show details
|
|
|
|